Sep 07 13:35:54 devstack cinder-volume[76616]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 13:35:54 devstack cinder-volume[76616]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 13:35:54 devstack cinder-volume[76616]: we strongly recommend against using it for new projects. Sep 07 13:35:54 devstack cinder-volume[76616]: If you are already using Eventlet, we recommend migrating to a different Sep 07 13:35:54 devstack cinder-volume[76616]: framework. For more detail see Sep 07 13:35:54 devstack cinder-volume[76616]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 13:35:54 devstack cinder-volume[76616]: import eventlet # noqa Sep 07 13:35:56 devstack cinder-volume[76616]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76616) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 13:35:56 devstack cinder-volume[76616]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76616) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 13:35:56 devstack cinder-volume[76616]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76616) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 13:35:57 devstack cinder-volume[76616]: INFO dbcounter [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Registered counter for database cinder Sep 07 13:35:57 devstack cinder-volume[76616]: DEBUG oslo_db.sqlalchemy.engines [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76616) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:35:58 devstack cinder-volume[76616]: DEBUG dbcounter [-] [76616] Writer thread running {{(pid=76616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 13:35:58 devstack cinder-volume[76616]: INFO cinder.rpc [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 13:35:58 devstack cinder-volume[76616]: INFO cinder.rpc [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 13:35:58 devstack cinder-volume[76616]: DEBUG oslo_db.sqlalchemy.engines [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76616) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:35:58 devstack cinder-volume[76616]: INFO cinder.volume.manager [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Determined volume DB was empty at startup. Sep 07 13:35:58 devstack cinder-volume[76616]: DEBUG cinder.volume.manager [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76616) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 13:35:58 devstack cinder-volume[76616]: INFO cinder.volume.manager [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 07 13:35:58 devstack cinder-volume[76616]: WARNING stevedore.named [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 13:35:58 devstack cinder-volume[76616]: WARNING castellan.key_manager [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 13:35:58 devstack cinder-volume[76616]: WARNING cinder.keymgr.conf_key_mgr [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 13:35:58 devstack cinder-volume[76616]: DEBUG cinder.volume.drivers.lvm [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76616) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 07 13:35:58 devstack cinder-volume[76616]: DEBUG oslo_concurrency.processutils [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:35:58 devstack cinder-volume[76616]: DEBUG oslo_concurrency.processutils [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] CMD "cinder-rtstool verify" returned: 0 in 0.408s {{(pid=76616) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:35:58 devstack cinder-volume[76616]: DEBUG oslo_db.sqlalchemy.engines [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76616) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:35:58 devstack cinder-volume[76616]: INFO cinder.rpc [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 07 13:35:58 devstack cinder-volume[76616]: INFO cinder.rpc [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 07 13:35:58 devstack cinder-volume[76616]: WARNING stevedore.named [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 13:35:58 devstack cinder-volume[76616]: WARNING castellan.key_manager [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 13:35:58 devstack cinder-volume[76616]: INFO cinder.volume.manager [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 07 13:35:58 devstack cinder-volume[76616]: DEBUG oslo_db.sqlalchemy.engines [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76616) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:35:59 devstack cinder-volume[76616]: INFO oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Starting 1 workers Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Started child 76783 {{(pid=76616) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Full set of CONF: {{(pid=76616) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] ******************************************************************************** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Configuration options gathered from: {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] ================================================================================ {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] allow_availability_zone_fallback = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] allow_compression_on_image_upload = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] allowed_direct_url_schemes = [] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] api_rate_limit = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] auth_strategy = keystone {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] az_cache_duration = 3600 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_availability_zone = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_host = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_name = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_stats_polling_interval = 60 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backup_api_class = cinder.backup.api.API {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backup_name_template = backup-%s {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backup_use_same_host = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backup_use_temp_snapshot = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] chap_password = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] chap_username = {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cinder_internal_tenant_project_id = c25a21af7839405b87f049cc2b32e6d1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cinder_internal_tenant_user_id = daf72492830042d291d4ad10c41b733b {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cloned_volume_same_az = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cluster = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] compression_format = gzip {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] compute_api_class = cinder.compute.nova.API {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] config_dir = [] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] config_source = [] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76783]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] control_exchange = openstack {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] debug = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] default_availability_zone = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] default_group_type = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] default_volume_type = lvmdriver-1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] disk_geometry = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] driver_client_cert = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] driver_client_cert_key = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] driver_data_namespace = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] driver_ssl_cert_path = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] driver_ssl_cert_verify = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] driver_use_ssl = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] enable_force_upload = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] enable_new_services = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] enable_unsupported_driver = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] enabled_backends = ['lvmdriver-1'] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] enforce_multipath_for_image_xfer = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] filter_function = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance_api_insecure = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance_api_servers = ['http://192.168.122.11/image'] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance_api_ssl_compression = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance_ca_certificates_file = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance_catalog_info = image:glance:publicURL {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance_certfile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance_keyfile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance_num_retries = 3 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance_request_timeout = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] goodness_function = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] graceful_shutdown_timeout = 5 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] group_api_class = cinder.group.api.API {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] host = devstack {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] image_compress_on_upload = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] image_conversion_address_space_limit = 1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] image_conversion_cpu_limit = 60 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] image_conversion_disable = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] image_upload_use_cinder_backend = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] image_upload_use_internal_tenant = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] image_volume_cache_enabled = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] image_volume_cache_max_count = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] image_volume_cache_max_size_gb = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] init_host_max_objects_retrieval = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] instance_format = [instance: %(uuid)s] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] iscsi_target_flags = {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] iscsi_write_cache = on {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] iser_helper = tgtadm {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] iser_ip_address = 192.168.122.11 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] iser_port = 3260 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] log_color = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] log_config_append = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] log_dir = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] log_file = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] log_options = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] log_rotate_interval = 1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] log_rotate_interval_type = days {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] log_rotation_type = none {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] max_age = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] max_logfile_count = 30 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] max_logfile_size_mb = 200 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] max_over_subscription_ratio = 20.0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] message_reap_interval = 86400 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] message_ttl = 2592000 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] migration_create_volume_timeout_secs = 300 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] monkey_patch = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] monkey_patch_modules = [] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] my_ip = 192.168.122.11 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] no_snapshot_gb_quota = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] num_iser_scan_tries = 3 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] num_shell_tries = 3 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] num_volume_device_scan_tries = 3 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] nvmeof_conn_info_version = 1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] nvmet_ns_id = 10 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] nvmet_port_id = 1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] osapi_max_limit = 1000 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] osapi_volume_ext_list = [] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] osapi_volume_listen = 0.0.0.0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] osapi_volume_listen_port = 8776 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] osapi_volume_use_ssl = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] osapi_volume_workers = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] per_volume_size_limit = -1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] periodic_fuzzy_delay = 60 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] periodic_interval = 60 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] project_id_regex = [0-9a-f\-]+ {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] public_endpoint = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] publish_errors = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] quota_backup_gigabytes = 1000 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] quota_backups = 10 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] quota_gigabytes = 1000 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] quota_groups = 10 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] quota_snapshots = 10 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] quota_volumes = 10 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] rate_limit_burst = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] rate_limit_except_level = CRITICAL {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] rate_limit_interval = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] reinit_driver_count = 3 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] replication_device = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] report_discard_supported = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] report_interval = 120 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] reservation_clean_interval = 86400 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] reservation_expire = 86400 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] reserved_image_namespaces = [] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] reserved_percentage = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] rpc_response_timeout = 120 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] run_external_periodic_tasks = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] scst_target_driver = iscsi {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] scst_target_iqn_name = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] service_down_time = 720 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] shell_completion = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] snapshot_name_template = snapshot-%s {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] snapshot_same_host = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] split_loggers = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] state_path = /opt/stack/data/cinder {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] storage_availability_zone = nova {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] storage_protocol = iSCSI {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] syslog_log_facility = LOG_USER {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] target_helper = lioadm {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] target_ip_address = 192.168.122.11 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] target_port = 3260 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] target_protocol = iscsi {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] target_secondary_ip_addresses = [] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] trace_flags = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] transfer_api_class = cinder.transfer.api.API {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] transport_url = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] until_refresh = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] use_chap_auth = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] use_default_quota_class = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] use_journal = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] use_json = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] use_multipath_for_image_xfer = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] use_stderr = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] use_syslog = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] verify_glance_signatures = enabled {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] volume_api_class = cinder.volume.api.API {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] volume_backend_name = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] volume_clear = zero {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] volume_clear_ionice = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] volume_clear_size = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] volume_copy_bps_limit = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] volume_dd_blocksize = 1M {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] volume_name_template = volume-%s {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] volume_service_inithost_offload = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] volume_usage_audit_period = month {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] zoning_mode = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_concurrency.disable_process_locking = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.auth_section = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.auth_type = password {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.auth_version = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.cache = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.certfile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.delay_auth_decision = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.http_connect_timeout = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.include_service_catalog = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76783]: INFO cinder.volume.manager [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.insecure = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.interface = public {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.keyfile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcache_password = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcache_username = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.region_name = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.service_token_roles_required = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.service_type = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.token_cache_time = 300 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.11/identity {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.backend = dogpile.cache.null {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.backend_argument = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.backend_expiration_time = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.config_prefix = cache.oslo {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.debug_cache_backend = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.enable_retry_client = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.enable_socket_keepalive = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.enabled = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.expiration_time = 600 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.hashclient_retry_attempts = 2 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.memcache_dead_retry = 300 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.memcache_pool_maxsize = 10 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.memcache_sasl_enabled = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.password = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.proxies = [] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.redis_db = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.redis_sentinel_service_name = mymaster {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.redis_server = localhost:6379 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.retry_attempts = 2 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.retry_delay = 0.0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.socket_keepalive_count = 1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.socket_keepalive_idle = 1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.socket_keepalive_interval = 1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.socket_timeout = 1.0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.tls_allowed_ciphers = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.tls_cafile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.tls_certfile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.tls_enabled = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.tls_keyfile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cache.username = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] coordination.backend_url = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.asyncio_connection = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.asyncio_slave_connection = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.backend = sqlalchemy {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.connection = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.connection_debug = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.connection_parameters = {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.connection_recycle_time = 3600 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.connection_trace = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.db_inc_retry_interval = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.db_max_retries = 20 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.db_max_retry_interval = 10 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.db_retry_interval = 1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.max_overflow = 50 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.max_pool_size = 5 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.max_retries = 10 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.mysql_wsrep_sync_wait = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.pool_timeout = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.retry_interval = 10 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.slave_connection = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.sqlite_synchronous = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.synchronous_reader = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] database.use_db_reconnect = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.047s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_tracing.insecure = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] profiler.connection_string = messaging:// {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] profiler.enabled = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] profiler.es_doc_type = notification {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] profiler.es_scroll_size = 10000 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] profiler.es_scroll_time = 2m {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] profiler.filter_error_trace = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] profiler.hmac_keys = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] profiler.sentinel_service_name = mymaster {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] profiler.socket_timeout = 0.1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] profiler.trace_requests = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] profiler.trace_sqlalchemy = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] profiler_jaeger.process_tags = {} {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] profiler_jaeger.service_name_prefix = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] profiler_otlp.service_name_prefix = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_policy.enforce_new_defaults = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_policy.policy_default_rule = default {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_policy.policy_file = policy.yaml {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_policy.remote_timeout = 60.0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] privsep_osbrick.group = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] privsep_osbrick.helper_command = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] privsep_osbrick.user = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cinder_sys_admin.group = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cinder_sys_admin.helper_command = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] cinder_sys_admin.user = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] service_user.auth_section = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] service_user.auth_type = password {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] service_user.cafile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] service_user.certfile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] service_user.collect_timing = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] service_user.insecure = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] service_user.keyfile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] service_user.send_service_user_token = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] service_user.split_loggers = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] service_user.timeout = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] service_user.tls_ciphers = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.037s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] service_user.tls_min_version = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance.auth_section = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance.auth_type = password {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance.certfile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance.collect_timing = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance.insecure = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance.keyfile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance.region_name = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance.split_loggers = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance.timeout = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance.tls_ciphers = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] glance.tls_min_version = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.backend_availability_zone = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.chap_password = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.chap_username = {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.disk_geometry = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.driver_client_cert = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.driver_client_cert_key = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.driver_data_namespace = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.driver_use_ssl = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.enable_unsupported_driver = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.extra_capabilities = {} {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.filter_function = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.goodness_function = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.iscsi_target_flags = {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.iscsi_write_cache = on {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.iser_helper = tgtadm {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.iser_ip_address = 192.168.122.11 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.iser_port = 3260 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.lvm_mirrors = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.lvm_share_target = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.lvm_type = auto {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.num_shell_tries = 3 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.nvmet_port_id = 1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.replication_device = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.report_discard_supported = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.reserved_percentage = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.scst_target_driver = iscsi {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.scst_target_iqn_name = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.048s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.storage_protocol = iSCSI {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.target_helper = tgtadm {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.target_ip_address = 192.168.122.11 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.target_port = 3260 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.target_protocol = iscsi {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.trace_flags = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.unique_fqdn_network = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.use_chap_auth = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.volume_backend_name = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.volume_clear = zero {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.volume_clear_ionice = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.volume_clear_size = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.volume_group = cinder-volumes {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_reports.file_event_handler = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_reports.log_dir = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.backend_availability_zone = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.backend_host = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.chap_password = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.chap_username = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.chiscsi_conf = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.disk_geometry = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.driver_client_cert = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.driver_data_namespace = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.driver_use_ssl = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.extra_capabilities = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.filter_function = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.goodness_function = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.iser_helper = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.iser_ip_address = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.iser_port = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.iser_target_prefix = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.lvm_conf_file = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.lvm_mirrors = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.lvm_share_target = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.lvm_type = auto {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.num_shell_tries = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.nvmet_port_id = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.replication_device = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.report_discard_supported = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.reserved_percentage = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.scst_target_driver = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.storage_protocol = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.target_helper = lioadm {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.target_ip_address = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.target_port = 3260 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.target_protocol = iscsi {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack sudo[76787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 07 13:35:59 devstack sudo[76787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.trace_flags = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.use_chap_auth = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.volume_clear = zero {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.volume_clear_size = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] lvmdriver-1.volumes_dir = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.ssl = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.ssl_version = {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_notifications.driver = [] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_notifications.retry = -1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] oslo_messaging_notifications.transport_url = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] key_manager.fixed_key = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.barbican_api_version = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.barbican_endpoint = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.barbican_endpoint_type = public {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.barbican_region_name = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.cafile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.certfile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.collect_timing = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.insecure = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.keyfile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.number_of_retries = 60 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.retry_delay = 1 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.send_service_user_token = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.split_loggers = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.timeout = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.tls_ciphers = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.tls_min_version = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.verify_ssl = True {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican.verify_ssl_path = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican_service_user.auth_section = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican_service_user.auth_type = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican_service_user.cafile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican_service_user.certfile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican_service_user.collect_timing = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican_service_user.insecure = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican_service_user.keyfile = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican_service_user.split_loggers = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican_service_user.timeout = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican_service_user.tls_ciphers = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] barbican_service_user.tls_min_version = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] vault.approle_role_id = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] vault.approle_secret_id = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] vault.auth_method = approle {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] vault.auth_path = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] vault.kv_mountpoint = secret {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] vault.kv_path = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] vault.kv_version = 2 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] vault.namespace = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] vault.root_token_id = **** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] vault.ssl_ca_crt_file = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] vault.timeout = 60.0 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] vault.token_file = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] vault.token_role = None {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] vault.use_ssl = False {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:35:59 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] ******************************************************************************** {{(pid=76616) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 13:35:59 devstack sudo[76787]: pam_unix(sudo:session): session closed for user root Sep 07 13:35:59 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.360s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:35:59 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:35:59 devstack sudo[76790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:35:59 devstack sudo[76790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:35:59 devstack sudo[76790]: pam_unix(sudo:session): session closed for user root Sep 07 13:35:59 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.261s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:35:59 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:35:59 devstack cinder-volume[76783]: INFO cinder.brick.local_dev.lvm [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 07 13:35:59 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:35:59 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:35:59 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:35:59 devstack sudo[76898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:35:59 devstack sudo[76898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:00 devstack sudo[76898]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:00 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.299s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:00 devstack cinder-volume[76783]: DEBUG cinder.brick.local_dev.lvm [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76783) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 07 13:36:00 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:00 devstack sudo[76991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:36:00 devstack sudo[76991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:00 devstack sudo[76991]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:00 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.567s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:00 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:00 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:00 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:00 devstack sudo[77163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:36:00 devstack sudo[77163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:01 devstack sudo[77163]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:01 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:01 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:01 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:01 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:01 devstack sudo[77253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 07 13:36:01 devstack sudo[77253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:01 devstack sudo[77253]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:01 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.285s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:01 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:01 devstack sudo[77325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:36:01 devstack sudo[77325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:01 devstack sudo[77325]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:01 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.351s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:01 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:01 devstack sudo[77405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:36:01 devstack sudo[77405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:02 devstack sudo[77405]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:02 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:02 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:02 devstack sudo[77463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:36:02 devstack sudo[77463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:02 devstack sudo[77463]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:02 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.321s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:02 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:02 devstack sudo[77492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:36:02 devstack sudo[77492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:02 devstack sudo[77492]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:02 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:02 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:02 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.041s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:02 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:02 devstack sudo[77520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:36:02 devstack sudo[77520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:03 devstack sudo[77520]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:03 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.310s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:03 devstack cinder-volume[76783]: INFO cinder.volume.drivers.lvm [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 07 13:36:03 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:03 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:03 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:03 devstack sudo[77586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:36:03 devstack sudo[77586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:03 devstack sudo[77586]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:03 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:03 devstack cinder-volume[76783]: DEBUG cinder.volume.drivers.lvm [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Updating volume stats {{(pid=76783) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 13:36:03 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:03 devstack sudo[77589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:36:03 devstack sudo[77589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:03 devstack sudo[77589]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:03 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.280s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:03 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:03 devstack sudo[77592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:36:03 devstack sudo[77592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:03 devstack sudo[77592]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:03 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:03 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:03 devstack sudo[77595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:36:03 devstack sudo[77595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:04 devstack sudo[77595]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:04 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:04 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:04 devstack sudo[77604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:36:04 devstack sudo[77604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:04 devstack sudo[77604]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:04 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:04 devstack cinder-volume[76783]: INFO cinder.volume.driver [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Driver hasn't implemented _init_vendor_properties() Sep 07 13:36:04 devstack cinder-volume[76783]: DEBUG cinder.volume.driver [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76783) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 13:36:04 devstack cinder-volume[76783]: DEBUG oslo_db.sqlalchemy.engines [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76783) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:36:04 devstack cinder-volume[76783]: DEBUG dbcounter [-] [76783] Writer thread running {{(pid=76783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 13:36:04 devstack cinder-volume[76783]: DEBUG cinder.db.api [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Building query based on filter {{(pid=76783) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 13:36:04 devstack cinder-volume[76783]: DEBUG cinder.image.image_utils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76783) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 13:36:04 devstack cinder-volume[76783]: INFO cinder.keymgr.migration [None req-a8d3bfe0-b15a-4a42-b4ab-dab439f200ce None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 13:36:04 devstack cinder-volume[76783]: DEBUG cinder.volume.drivers.lvm [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Updating volume stats {{(pid=76783) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 13:36:04 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:04 devstack sudo[77608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:36:04 devstack sudo[77608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:04 devstack sudo[77608]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:04 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.291s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:04 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:04 devstack sudo[77611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:36:04 devstack sudo[77611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:05 devstack sudo[77611]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:05 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:05 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:05 devstack sudo[77616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:36:05 devstack sudo[77616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:05 devstack sudo[77616]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:05 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:05 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:05 devstack sudo[77619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:36:05 devstack sudo[77619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:05 devstack sudo[77619]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:05 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:05 devstack cinder-volume[76783]: DEBUG cinder.manager [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Notifying Schedulers of capabilities ... {{(pid=76783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:36:05 devstack cinder-volume[76783]: INFO cinder.volume.manager [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Driver initialization completed successfully. Sep 07 13:36:05 devstack cinder-volume[76783]: INFO cinder.manager [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Initiating service 2 cleanup Sep 07 13:36:05 devstack cinder-volume[76783]: INFO cinder.manager [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Service 2 cleanup completed. Sep 07 13:36:05 devstack cinder-volume[76783]: DEBUG cinder.service [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Creating RPC server for service cinder-volume {{(pid=76783) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 13:36:05 devstack cinder-volume[76783]: DEBUG cinder.service [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76783) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 13:36:05 devstack cinder-volume[76783]: INFO cinder.volume.manager [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 07 13:36:05 devstack cinder-volume[76783]: DEBUG cinder.volume.drivers.lvm [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Updating volume stats {{(pid=76783) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 13:36:05 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:05 devstack sudo[77623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:36:05 devstack sudo[77623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:06 devstack sudo[77623]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:06 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:06 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:06 devstack sudo[77626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:36:06 devstack sudo[77626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:06 devstack sudo[77626]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:06 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:06 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:06 devstack sudo[77631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:36:06 devstack sudo[77631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:06 devstack sudo[77631]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:06 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:06 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:36:06 devstack sudo[77634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:36:06 devstack sudo[77634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:36:06 devstack sudo[77634]: pam_unix(sudo:session): session closed for user root Sep 07 13:36:06 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.295s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:36:06 devstack cinder-volume[76783]: INFO cinder.volume.manager [None req-12445d05-7dbe-4553-8eca-49f25aeb472a None None] Driver post RPC initialization completed successfully. Sep 07 13:36:09 devstack cinder-volume[76616]: DEBUG dbcounter [-] [76616] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76616) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:36:16 devstack cinder-volume[76783]: DEBUG dbcounter [-] [76783] Writing DB stats cinder:SELECT=3 {{(pid=76783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:36:17 devstack cinder-volume[76783]: DEBUG dbcounter [-] [76783] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:36:38 devstack cinder-volume[76783]: DEBUG oslo_service.periodic_task [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running periodic task VolumeManager._thread_info {{(pid=76783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:36:38 devstack cinder-volume[76783]: DEBUG cinder.volume.manager [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] thread count: 6 {{(pid=76783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:36:38 devstack cinder-volume[76783]: DEBUG cinder.volume.manager [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] thread info: [<_MainThread(MainThread, started 130659640987776)>, , , , , ] {{(pid=76783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:37:38 devstack cinder-volume[76783]: DEBUG oslo_service.periodic_task [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:37:38 devstack cinder-volume[76783]: DEBUG cinder.volume.drivers.lvm [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Updating volume stats {{(pid=76783) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 13:37:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:38 devstack sudo[80313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:37:38 devstack sudo[80313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:37:38 devstack sudo[80313]: pam_unix(sudo:session): session closed for user root Sep 07 13:37:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:37:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:38 devstack sudo[80316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:37:38 devstack sudo[80316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:37:38 devstack sudo[80316]: pam_unix(sudo:session): session closed for user root Sep 07 13:37:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:37:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:38 devstack sudo[80319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:37:38 devstack sudo[80319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:37:38 devstack sudo[80319]: pam_unix(sudo:session): session closed for user root Sep 07 13:37:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:37:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:37:38 devstack sudo[80322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:37:38 devstack sudo[80322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:37:39 devstack sudo[80322]: pam_unix(sudo:session): session closed for user root Sep 07 13:37:39 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:37:39 devstack cinder-volume[76783]: DEBUG cinder.manager [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Notifying Schedulers of capabilities ... {{(pid=76783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:37:39 devstack cinder-volume[76783]: DEBUG oslo_service.periodic_task [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running periodic task VolumeManager._thread_info {{(pid=76783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:37:39 devstack cinder-volume[76783]: DEBUG cinder.volume.manager [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] thread count: 6 {{(pid=76783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:37:39 devstack cinder-volume[76783]: DEBUG cinder.volume.manager [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] thread info: [<_MainThread(MainThread, started 130659640987776)>, , , , , ] {{(pid=76783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:38:17 devstack cinder-volume[76783]: DEBUG dbcounter [-] [76783] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:38:38 devstack cinder-volume[76783]: DEBUG oslo_service.periodic_task [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:38:38 devstack cinder-volume[76783]: DEBUG cinder.volume.drivers.lvm [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Updating volume stats {{(pid=76783) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 13:38:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:38 devstack sudo[84037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:38:38 devstack sudo[84037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:38 devstack sudo[84037]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:38 devstack sudo[84040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:38:38 devstack sudo[84040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:38 devstack sudo[84040]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:38 devstack sudo[84043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:38:38 devstack sudo[84043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:38 devstack sudo[84043]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:38:38 devstack sudo[84046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:38:38 devstack sudo[84046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:38:39 devstack sudo[84046]: pam_unix(sudo:session): session closed for user root Sep 07 13:38:39 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:38:39 devstack cinder-volume[76783]: DEBUG cinder.manager [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Notifying Schedulers of capabilities ... {{(pid=76783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:38:39 devstack cinder-volume[76783]: DEBUG oslo_service.periodic_task [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running periodic task VolumeManager._thread_info {{(pid=76783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:38:39 devstack cinder-volume[76783]: DEBUG cinder.volume.manager [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] thread count: 6 {{(pid=76783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:38:39 devstack cinder-volume[76783]: DEBUG cinder.volume.manager [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] thread info: [<_MainThread(MainThread, started 130659640987776)>, , , , , ] {{(pid=76783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:39:38 devstack cinder-volume[76783]: DEBUG oslo_service.periodic_task [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:39:38 devstack cinder-volume[76783]: DEBUG cinder.volume.drivers.lvm [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Updating volume stats {{(pid=76783) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 13:39:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:39:38 devstack sudo[85702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:39:38 devstack sudo[85702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:39:38 devstack sudo[85702]: pam_unix(sudo:session): session closed for user root Sep 07 13:39:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:39:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:39:38 devstack sudo[85705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:39:38 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:39:38 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root Sep 07 13:39:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:39:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:39:38 devstack sudo[85709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:39:38 devstack sudo[85709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:39:38 devstack sudo[85709]: pam_unix(sudo:session): session closed for user root Sep 07 13:39:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.253s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:39:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:39:38 devstack sudo[85712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:39:38 devstack sudo[85712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:39:39 devstack sudo[85712]: pam_unix(sudo:session): session closed for user root Sep 07 13:39:39 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:39:39 devstack cinder-volume[76783]: DEBUG cinder.manager [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Notifying Schedulers of capabilities ... {{(pid=76783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:40:17 devstack cinder-volume[76783]: DEBUG dbcounter [-] [76783] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76783) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:40:33 devstack cinder-volume[76616]: INFO oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Caught SIGTERM, stopping children Sep 07 13:40:33 devstack cinder-volume[76616]: DEBUG oslo_concurrency.lockutils [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Acquiring lock "singleton_lock" {{(pid=76616) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 13:40:33 devstack cinder-volume[76616]: DEBUG oslo_concurrency.lockutils [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Acquired lock "singleton_lock" {{(pid=76616) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 13:40:33 devstack cinder-volume[76616]: DEBUG oslo_concurrency.lockutils [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Releasing lock "singleton_lock" {{(pid=76616) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 13:40:33 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Stop services. {{(pid=76616) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 07 13:40:33 devstack cinder-volume[76616]: DEBUG oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Killing children. {{(pid=76616) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 07 13:40:33 devstack cinder-volume[76616]: INFO oslo_service.backend._eventlet.service [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Waiting on 1 children to exit Sep 07 13:40:38 devstack cinder-volume[76783]: DEBUG oslo_service.periodic_task [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:40:38 devstack cinder-volume[76783]: DEBUG cinder.volume.drivers.lvm [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Updating volume stats {{(pid=76783) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 07 13:40:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:38 devstack cinder-volume[76783]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 07 13:40:38 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 07 13:40:38 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:40:38 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Sep 07 13:40:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:38 devstack sudo[86820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:40:38 devstack sudo[86820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:40:38 devstack cinder-volume[86799]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 13:40:38 devstack cinder-volume[86799]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 13:40:38 devstack cinder-volume[86799]: we strongly recommend against using it for new projects. Sep 07 13:40:38 devstack cinder-volume[86799]: If you are already using Eventlet, we recommend migrating to a different Sep 07 13:40:38 devstack cinder-volume[86799]: framework. For more detail see Sep 07 13:40:38 devstack cinder-volume[86799]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 13:40:38 devstack cinder-volume[86799]: import eventlet # noqa Sep 07 13:40:38 devstack sudo[86820]: pam_unix(sudo:session): session closed for user root Sep 07 13:40:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:38 devstack sudo[86828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 07 13:40:38 devstack sudo[86828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:40:38 devstack sudo[86828]: pam_unix(sudo:session): session closed for user root Sep 07 13:40:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.262s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:38 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:38 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 07 13:40:38 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:40:39 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Sep 07 13:40:39 devstack cinder-volume[76783]: DEBUG oslo_concurrency.processutils [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76783) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:39 devstack cinder-volume[76783]: DEBUG cinder.manager [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Notifying Schedulers of capabilities ... {{(pid=76783) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:40:39 devstack cinder-volume[76783]: DEBUG oslo_service.periodic_task [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] Running periodic task VolumeManager._thread_info {{(pid=76783) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:40:39 devstack cinder-volume[76783]: DEBUG cinder.volume.manager [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] thread count: 6 {{(pid=76783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:40:39 devstack cinder-volume[76783]: DEBUG cinder.volume.manager [None req-6f0a1132-011f-4423-b106-8a85c1abfce9 None None] thread info: [<_MainThread(MainThread, started 130659640987776)>, , , , , ] {{(pid=76783) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:40:40 devstack cinder-volume[86799]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86799) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 13:40:40 devstack cinder-volume[86799]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86799) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 13:40:40 devstack cinder-volume[86799]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86799) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 13:40:40 devstack cinder-volume[76783]: DEBUG oslo_concurrency.lockutils [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Acquiring lock "singleton_lock" {{(pid=76783) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 13:40:40 devstack cinder-volume[76783]: DEBUG oslo_concurrency.lockutils [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Acquired lock "singleton_lock" {{(pid=76783) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 13:40:40 devstack cinder-volume[76783]: DEBUG oslo_concurrency.lockutils [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Releasing lock "singleton_lock" {{(pid=76783) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 13:40:40 devstack cinder-volume[76783]: WARNING amqp [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 13:40:40 devstack cinder-volume[76783]: WARNING amqp [None req-e869d638-2a1d-49c6-a4c9-165b69fbe8c2 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 13:40:41 devstack cinder-volume[86799]: INFO dbcounter [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Registered counter for database cinder Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_db.sqlalchemy.engines [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86799) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG dbcounter [-] [86799] Writer thread running {{(pid=86799) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 13:40:41 devstack cinder-volume[86799]: INFO cinder.rpc [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 13:40:41 devstack cinder-volume[86799]: INFO cinder.rpc [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_db.sqlalchemy.engines [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86799) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:40:41 devstack cinder-volume[86799]: INFO cinder.volume.manager [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Determined volume DB was empty at startup. Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG cinder.volume.manager [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86799) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 13:40:41 devstack cinder-volume[86799]: INFO cinder.volume.manager [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 07 13:40:41 devstack cinder-volume[86799]: WARNING stevedore.named [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 13:40:41 devstack cinder-volume[86799]: WARNING castellan.key_manager [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 13:40:41 devstack cinder-volume[86799]: WARNING cinder.keymgr.conf_key_mgr [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 13:40:41 devstack cinder-volume[86799]: INFO cinder.volume.manager [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_db.sqlalchemy.engines [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86799) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:40:41 devstack cinder-volume[86799]: INFO oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Starting 1 workers Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Started child 87034 {{(pid=86799) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Full set of CONF: {{(pid=86799) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] ******************************************************************************** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Configuration options gathered from: {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] ================================================================================ {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] allow_availability_zone_fallback = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] allow_compression_on_image_upload = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] allowed_direct_url_schemes = [] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] api_rate_limit = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] auth_strategy = keystone {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_availability_zone = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_host = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_name = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_stats_polling_interval = 60 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backup_api_class = cinder.backup.api.API {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backup_name_template = backup-%s {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backup_use_same_host = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backup_use_temp_snapshot = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] chap_password = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] chap_username = {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cinder_internal_tenant_project_id = c25a21af7839405b87f049cc2b32e6d1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cinder_internal_tenant_user_id = daf72492830042d291d4ad10c41b733b {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cluster = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:41 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] compression_format = gzip {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[87034]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] compute_api_class = cinder.compute.nova.API {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] config_dir = [] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] config_source = [] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] control_exchange = openstack {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] debug = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] default_availability_zone = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] default_group_type = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] default_volume_type = QuobyteHD {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] disk_geometry = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] driver_client_cert = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] driver_client_cert_key = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] driver_data_namespace = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] driver_ssl_cert_path = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] driver_ssl_cert_verify = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] driver_use_ssl = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] enable_new_services = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] enable_unsupported_driver = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] enabled_backends = ['QuobyteHD'] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] enforce_multipath_for_image_xfer = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] filter_function = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance_api_insecure = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance_api_servers = ['http://192.168.122.11/image'] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance_api_ssl_compression = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance_ca_certificates_file = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance_catalog_info = image:glance:publicURL {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance_certfile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance_keyfile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance_num_retries = 3 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance_request_timeout = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] goodness_function = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] graceful_shutdown_timeout = 5 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] group_api_class = cinder.group.api.API {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] host = devstack {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] image_compress_on_upload = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] image_conversion_address_space_limit = 1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] image_conversion_cpu_limit = 60 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] image_conversion_disable = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] image_upload_use_cinder_backend = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] image_upload_use_internal_tenant = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] image_volume_cache_enabled = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] image_volume_cache_max_count = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] image_volume_cache_max_size_gb = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] init_host_max_objects_retrieval = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] instance_format = [instance: %(uuid)s] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] iscsi_target_flags = {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] iscsi_write_cache = on {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] iser_helper = tgtadm {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] iser_ip_address = 192.168.122.11 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] iser_port = 3260 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] log_color = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] log_config_append = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] log_dir = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] log_file = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] log_options = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] log_rotate_interval = 1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] log_rotate_interval_type = days {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] log_rotation_type = none {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] max_age = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] max_logfile_count = 30 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] max_logfile_size_mb = 200 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] max_over_subscription_ratio = 20.0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] message_reap_interval = 86400 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] message_ttl = 2592000 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] migration_create_volume_timeout_secs = 300 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] monkey_patch = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] monkey_patch_modules = [] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] my_ip = 192.168.122.11 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] no_snapshot_gb_quota = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] num_iser_scan_tries = 3 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] num_shell_tries = 3 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] num_volume_device_scan_tries = 3 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] nvmeof_conn_info_version = 1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] nvmet_ns_id = 10 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] nvmet_port_id = 1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] osapi_max_limit = 1000 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] osapi_volume_ext_list = [] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] osapi_volume_listen_port = 8776 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] osapi_volume_use_ssl = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] osapi_volume_workers = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] per_volume_size_limit = -1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] periodic_fuzzy_delay = 60 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] periodic_interval = 60 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] public_endpoint = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] publish_errors = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] quota_backup_gigabytes = 1000 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] quota_backups = 10 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] quota_gigabytes = 1000 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] quota_groups = 10 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] quota_snapshots = 10 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] quota_volumes = 10 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] rate_limit_burst = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] rate_limit_except_level = CRITICAL {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] rate_limit_interval = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] reinit_driver_count = 3 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] replication_device = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] report_discard_supported = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] report_interval = 120 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] reservation_clean_interval = 86400 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] reservation_expire = 86400 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] reserved_image_namespaces = [] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] reserved_percentage = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] rpc_response_timeout = 120 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] run_external_periodic_tasks = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] scst_target_driver = iscsi {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] scst_target_iqn_name = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] service_down_time = 720 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] shell_completion = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] snapshot_name_template = snapshot-%s {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] split_loggers = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] state_path = /opt/stack/data/cinder {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] storage_availability_zone = nova {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] storage_protocol = iSCSI {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] syslog_log_facility = LOG_USER {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] target_helper = lioadm {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] target_ip_address = 192.168.122.11 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] target_port = 3260 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] target_protocol = iscsi {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] target_secondary_ip_addresses = [] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] trace_flags = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] transport_url = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] until_refresh = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] use_chap_auth = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] use_default_quota_class = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] use_journal = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] use_json = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] use_multipath_for_image_xfer = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] use_stderr = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] use_syslog = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] verify_glance_signatures = enabled {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] volume_api_class = cinder.volume.api.API {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] volume_backend_name = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] volume_clear = zero {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] volume_clear_ionice = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] volume_clear_size = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] volume_copy_bps_limit = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] volume_dd_blocksize = 1M {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] volume_name_template = volume-%s {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] volume_service_inithost_offload = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] volume_usage_audit_period = month {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] zoning_mode = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_concurrency.disable_process_locking = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 07 13:40:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.remotefs [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87034) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.auth_section = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.auth_type = password {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.auth_version = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.cache = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.certfile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.include_service_catalog = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.insecure = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.interface = public {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.keyfile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcache_password = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcache_username = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.region_name = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.service_type = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.11/identity {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.backend = dogpile.cache.null {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.backend_argument = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.backend_expiration_time = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.config_prefix = cache.oslo {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.debug_cache_backend = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.enable_retry_client = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.enable_socket_keepalive = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.enabled = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.expiration_time = 600 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.hashclient_retry_attempts = 2 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.memcache_dead_retry = 300 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.memcache_pool_maxsize = 10 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.memcache_sasl_enabled = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.password = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.proxies = [] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.redis_db = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.redis_server = localhost:6379 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.retry_attempts = 2 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.retry_delay = 0.0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.socket_keepalive_count = 1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.socket_keepalive_idle = 1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.socket_keepalive_interval = 1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.socket_timeout = 1.0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.tls_allowed_ciphers = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.tls_cafile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.tls_certfile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.tls_enabled = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.tls_keyfile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cache.username = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] coordination.backend_url = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.asyncio_connection = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.asyncio_slave_connection = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.backend = sqlalchemy {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.connection = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.connection_debug = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.connection_parameters = {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.connection_recycle_time = 3600 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.connection_trace = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.db_inc_retry_interval = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.db_max_retries = 20 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.db_max_retry_interval = 10 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.db_retry_interval = 1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.max_overflow = 50 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.max_pool_size = 5 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.max_retries = 10 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.mysql_wsrep_sync_wait = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.pool_timeout = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.retry_interval = 10 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.slave_connection = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.sqlite_synchronous = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.synchronous_reader = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] database.use_db_reconnect = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_tracing.insecure = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87034) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] profiler.connection_string = messaging:// {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] profiler.enabled = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] profiler.es_doc_type = notification {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] profiler.es_scroll_size = 10000 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.quobyte [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 07 13:40:42 devstack cinder-volume[87034]: WARNING cinder.volume.drivers.quobyte [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] profiler.es_scroll_time = 2m {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] profiler.filter_error_trace = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] profiler.hmac_keys = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] profiler.sentinel_service_name = mymaster {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] profiler.socket_timeout = 0.1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] profiler.trace_requests = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] profiler.trace_sqlalchemy = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] profiler_jaeger.process_tags = {} {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Running cmd (subprocess): mount.quobyte {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] profiler_jaeger.service_name_prefix = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] profiler_otlp.service_name_prefix = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_policy.enforce_new_defaults = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_policy.policy_default_rule = default {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_policy.policy_file = policy.yaml {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] privsep_osbrick.group = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] privsep_osbrick.helper_command = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] privsep_osbrick.user = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cinder_sys_admin.group = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cinder_sys_admin.helper_command = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] cinder_sys_admin.user = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] service_user.auth_section = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] service_user.auth_type = password {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] service_user.cafile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] service_user.certfile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] service_user.collect_timing = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] service_user.insecure = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] service_user.keyfile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] service_user.send_service_user_token = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] service_user.split_loggers = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] service_user.timeout = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] service_user.tls_ciphers = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] service_user.tls_min_version = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance.auth_section = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance.auth_type = password {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance.certfile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance.collect_timing = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance.insecure = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance.keyfile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance.region_name = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance.split_loggers = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance.timeout = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance.tls_ciphers = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] glance.tls_min_version = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.backend_availability_zone = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.chap_password = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.chap_username = {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.disk_geometry = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.driver_client_cert = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.driver_client_cert_key = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.driver_data_namespace = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.driver_use_ssl = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.extra_capabilities = {} {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.filter_function = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.goodness_function = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.iscsi_target_flags = {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.iscsi_write_cache = on {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.iser_helper = tgtadm {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.iser_ip_address = 192.168.122.11 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.iser_port = 3260 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.nas_host = {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.nas_login = admin {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.nas_mount_options = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.nas_password = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.nas_private_key = {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.nas_share_path = {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.num_shell_tries = 3 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.quobyte_volume_url = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.replication_device = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.report_discard_supported = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.reserved_percentage = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack quobyte-client[87039]: Reading configuration file: /etc/quobyte/client.cfg Sep 07 13:40:42 devstack quobyte-client[87039]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.target_helper = tgtadm {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.target_ip_address = 192.168.122.11 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.target_port = 3260 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.target_protocol = iscsi {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.trace_flags = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.unique_fqdn_network = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.use_chap_auth = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[87034]: INFO cinder.volume.drivers.quobyte [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 ... Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.volume_backend_name = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 -c /etc/quobyte/client-cinder.cfg {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.volume_clear = zero {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.volume_clear_ionice = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.volume_clear_size = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_reports.file_event_handler = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_reports.log_dir = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.backend_availability_zone = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.backend_host = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.chap_password = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.chap_username = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.chiscsi_conf = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.disk_geometry = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.driver_client_cert = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.driver_data_namespace = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.driver_use_ssl = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.extra_capabilities = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.filter_function = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.goodness_function = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.iser_helper = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.iser_ip_address = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.iser_port = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.iser_target_prefix = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.nas_host = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.nas_login = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.nas_mount_options = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.nas_password = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.nas_private_key = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack sudo[87040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 -c /etc/quobyte/client-cinder.cfg Sep 07 13:40:42 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.nas_share_path = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.nas_ssh_port = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.num_shell_tries = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.nvmet_port_id = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.replication_device = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.report_discard_supported = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.reserved_percentage = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.scst_target_driver = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.storage_protocol = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.target_helper = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.target_ip_address = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.target_port = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.target_prefix = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.target_protocol = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.trace_flags = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.use_chap_auth = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.volume_clear = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.volume_clear_size = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] QuobyteHD.volumes_dir = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.ssl = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_notifications.driver = [] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_notifications.retry = -1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] key_manager.fixed_key = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.barbican_api_version = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.barbican_endpoint = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.barbican_endpoint_type = public {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.barbican_region_name = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.cafile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.certfile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.collect_timing = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.insecure = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.keyfile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.number_of_retries = 60 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.retry_delay = 1 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.send_service_user_token = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.split_loggers = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.timeout = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.tls_ciphers = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.tls_min_version = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.verify_ssl = True {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican.verify_ssl_path = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican_service_user.auth_section = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican_service_user.auth_type = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican_service_user.cafile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican_service_user.certfile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican_service_user.collect_timing = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican_service_user.insecure = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican_service_user.keyfile = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican_service_user.split_loggers = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican_service_user.timeout = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican_service_user.tls_ciphers = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] barbican_service_user.tls_min_version = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] vault.approle_role_id = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] vault.approle_secret_id = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] vault.auth_method = approle {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] vault.auth_path = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] vault.kv_mountpoint = secret {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] vault.kv_path = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] vault.kv_version = 2 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] vault.namespace = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] vault.root_token_id = **** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] vault.ssl_ca_crt_file = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] vault.timeout = 60.0 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] vault.token_file = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] vault.token_role = None {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] vault.use_ssl = False {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:42 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] ******************************************************************************** {{(pid=86799) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 13:40:42 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root Sep 07 13:40:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.405s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:42 devstack cinder-volume[87034]: INFO cinder.volume.drivers.quobyte [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 succeeded Sep 07 13:40:42 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:40:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.418s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:40:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:42 devstack sudo[87109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:40:42 devstack sudo[87109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:40:42 devstack sudo[87109]: pam_unix(sudo:session): session closed for user root Sep 07 13:40:42 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.254s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:42 devstack cinder-volume[87034]: INFO cinder.volume.driver [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Driver hasn't implemented _init_vendor_properties() Sep 07 13:40:42 devstack cinder-volume[87034]: DEBUG cinder.volume.driver [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5802955627441, 'free_capacity_gb': 1773.5802955627441, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87034) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 13:40:42 devstack cinder-volume[87034]: DEBUG oslo_db.sqlalchemy.engines [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87034) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG dbcounter [-] [87034] Writer thread running {{(pid=87034) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG cinder.db.api [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Building query based on filter {{(pid=87034) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG cinder.image.image_utils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87034) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 13:40:43 devstack cinder-volume[87034]: INFO cinder.keymgr.migration [None req-da9f61bf-ed26-4662-ab87-c7c6569ceeab None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:43 devstack sudo[87112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:40:43 devstack sudo[87112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:40:43 devstack sudo[87112]: pam_unix(sudo:session): session closed for user root Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.261s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG cinder.manager [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Notifying Schedulers of capabilities ... {{(pid=87034) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:40:43 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Driver initialization completed successfully. Sep 07 13:40:43 devstack cinder-volume[87034]: INFO cinder.manager [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Initiating service 3 cleanup Sep 07 13:40:43 devstack cinder-volume[87034]: INFO cinder.manager [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Service 3 cleanup completed. Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG cinder.service [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Creating RPC server for service cinder-volume {{(pid=87034) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG cinder.service [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87034) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 13:40:43 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87034) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG cinder.volume.drivers.quobyte [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87034) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87034) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:43 devstack sudo[87116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:40:43 devstack sudo[87116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:40:43 devstack sudo[87116]: pam_unix(sudo:session): session closed for user root Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG oslo_concurrency.processutils [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.253s {{(pid=87034) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:43 devstack cinder-volume[87034]: INFO cinder.volume.manager [None req-d9b8bd8a-3903-4668-8c26-ae9b7c1475d7 None None] Driver post RPC initialization completed successfully. Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG oslo_service.periodic_task [None req-09e74608-90ee-4a53-bae4-52d4ebb4c951 None None] Running periodic task VolumeManager._thread_info {{(pid=87034) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-09e74608-90ee-4a53-bae4-52d4ebb4c951 None None] thread count: 6 {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:40:43 devstack cinder-volume[87034]: DEBUG cinder.volume.manager [None req-09e74608-90ee-4a53-bae4-52d4ebb4c951 None None] thread info: [<_MainThread(MainThread, started 124479607070848)>, , , , , ] {{(pid=87034) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:40:47 devstack cinder-volume[86799]: INFO oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Caught SIGTERM, stopping children Sep 07 13:40:47 devstack cinder-volume[86799]: DEBUG oslo_concurrency.lockutils [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Acquiring lock "singleton_lock" {{(pid=86799) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 13:40:47 devstack cinder-volume[86799]: DEBUG oslo_concurrency.lockutils [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Acquired lock "singleton_lock" {{(pid=86799) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 13:40:47 devstack cinder-volume[86799]: DEBUG oslo_concurrency.lockutils [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Releasing lock "singleton_lock" {{(pid=86799) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 13:40:47 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Stop services. {{(pid=86799) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 07 13:40:47 devstack cinder-volume[86799]: DEBUG oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Killing children. {{(pid=86799) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 07 13:40:47 devstack cinder-volume[86799]: INFO oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Waiting on 1 children to exit Sep 07 13:40:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Acquiring lock "singleton_lock" {{(pid=87034) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 13:40:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Acquired lock "singleton_lock" {{(pid=87034) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 13:40:47 devstack cinder-volume[87034]: DEBUG oslo_concurrency.lockutils [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Releasing lock "singleton_lock" {{(pid=87034) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 13:40:47 devstack cinder-volume[87034]: WARNING amqp [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 13:40:47 devstack cinder-volume[87034]: WARNING amqp [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 07 13:40:47 devstack cinder-volume[86799]: INFO oslo_service.backend._eventlet.service [None req-bf5aa29f-f0a7-48bc-9940-0212199012b5 None None] Child 87034 exited with status 0 Sep 07 13:40:48 devstack cinder-volume[87352]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 07 13:40:48 devstack cinder-volume[87352]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 13:40:48 devstack cinder-volume[87352]: we strongly recommend against using it for new projects. Sep 07 13:40:48 devstack cinder-volume[87352]: If you are already using Eventlet, we recommend migrating to a different Sep 07 13:40:48 devstack cinder-volume[87352]: framework. For more detail see Sep 07 13:40:48 devstack cinder-volume[87352]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 13:40:48 devstack cinder-volume[87352]: import eventlet # noqa Sep 07 13:40:50 devstack cinder-volume[87352]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 07 13:40:50 devstack cinder-volume[87352]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 07 13:40:50 devstack cinder-volume[87352]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87352) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 07 13:40:50 devstack cinder-volume[87352]: INFO dbcounter [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] Registered counter for database cinder Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_db.sqlalchemy.engines [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87352) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG dbcounter [-] [87352] Writer thread running {{(pid=87352) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 13:40:51 devstack cinder-volume[87352]: INFO cinder.rpc [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 07 13:40:51 devstack cinder-volume[87352]: INFO cinder.rpc [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_db.sqlalchemy.engines [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87352) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:40:51 devstack cinder-volume[87352]: INFO cinder.volume.manager [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] Determined volume DB was empty at startup. Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG cinder.volume.manager [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87352) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 07 13:40:51 devstack cinder-volume[87352]: WARNING stevedore.named [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 07 13:40:51 devstack cinder-volume[87352]: WARNING castellan.key_manager [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 13:40:51 devstack cinder-volume[87352]: WARNING cinder.keymgr.conf_key_mgr [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 07 13:40:51 devstack cinder-volume[87352]: INFO cinder.volume.manager [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_db.sqlalchemy.engines [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87352) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:40:51 devstack cinder-volume[87352]: INFO oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] Starting 1 workers Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] Started child 87444 {{(pid=87352) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] Full set of CONF: {{(pid=87352) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] ******************************************************************************** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] Configuration options gathered from: {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] ================================================================================ {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] allow_availability_zone_fallback = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] allow_compression_on_image_upload = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] allowed_direct_url_schemes = [] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] api_rate_limit = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] auth_strategy = keystone {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_availability_zone = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_host = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_name = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_stats_polling_interval = 60 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backup_api_class = cinder.backup.api.API {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backup_name_template = backup-%s {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backup_use_same_host = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backup_use_temp_snapshot = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] chap_password = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] chap_username = {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cinder_internal_tenant_project_id = c25a21af7839405b87f049cc2b32e6d1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cinder_internal_tenant_user_id = daf72492830042d291d4ad10c41b733b {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cluster = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] compression_format = gzip {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87444]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] compute_api_class = cinder.compute.nova.API {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] config_dir = [] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] config_source = [] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] control_exchange = openstack {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] debug = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] default_availability_zone = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] default_group_type = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] default_volume_type = QuobyteHD {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] disk_geometry = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] driver_client_cert = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] driver_client_cert_key = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] driver_data_namespace = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] driver_ssl_cert_path = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] driver_ssl_cert_verify = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] driver_use_ssl = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] enable_new_services = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] enable_unsupported_driver = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] enabled_backends = ['QuobyteHD'] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] enforce_multipath_for_image_xfer = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] filter_function = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance_api_insecure = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance_api_servers = ['http://192.168.122.11/image'] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance_api_ssl_compression = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance_ca_certificates_file = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance_catalog_info = image:glance:publicURL {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance_certfile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance_keyfile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance_num_retries = 3 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance_request_timeout = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] goodness_function = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] graceful_shutdown_timeout = 5 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] group_api_class = cinder.group.api.API {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] host = devstack {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] image_compress_on_upload = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] image_conversion_address_space_limit = 1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] image_conversion_cpu_limit = 60 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] image_conversion_disable = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] image_upload_use_cinder_backend = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] image_upload_use_internal_tenant = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] image_volume_cache_enabled = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] image_volume_cache_max_count = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] image_volume_cache_max_size_gb = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] init_host_max_objects_retrieval = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] instance_format = [instance: %(uuid)s] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] iscsi_target_flags = {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] iscsi_write_cache = on {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] iser_helper = tgtadm {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] iser_ip_address = 192.168.122.11 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] iser_port = 3260 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] log_color = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] log_config_append = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] log_dir = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] log_file = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] log_options = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] log_rotate_interval = 1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] log_rotate_interval_type = days {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] log_rotation_type = none {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] max_age = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] max_logfile_count = 30 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] max_logfile_size_mb = 200 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] max_over_subscription_ratio = 20.0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] message_reap_interval = 86400 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] message_ttl = 2592000 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] migration_create_volume_timeout_secs = 300 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] monkey_patch = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] monkey_patch_modules = [] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] my_ip = 192.168.122.11 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] no_snapshot_gb_quota = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] num_iser_scan_tries = 3 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] num_shell_tries = 3 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] num_volume_device_scan_tries = 3 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] nvmeof_conn_info_version = 1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] nvmet_ns_id = 10 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] nvmet_port_id = 1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] osapi_max_limit = 1000 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] osapi_volume_ext_list = [] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] osapi_volume_listen_port = 8776 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] osapi_volume_use_ssl = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] osapi_volume_workers = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] per_volume_size_limit = -1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] periodic_fuzzy_delay = 60 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] periodic_interval = 60 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] public_endpoint = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] publish_errors = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] quota_backup_gigabytes = 1000 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] quota_backups = 10 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] quota_gigabytes = 1000 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] quota_groups = 10 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] quota_snapshots = 10 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] quota_volumes = 10 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] rate_limit_burst = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] rate_limit_except_level = CRITICAL {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] rate_limit_interval = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] reinit_driver_count = 3 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] replication_device = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] report_discard_supported = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] report_interval = 120 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] reservation_clean_interval = 86400 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] reservation_expire = 86400 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] reserved_image_namespaces = [] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] reserved_percentage = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] rpc_response_timeout = 120 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] run_external_periodic_tasks = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] scst_target_driver = iscsi {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] scst_target_iqn_name = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87444) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] service_down_time = 720 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] shell_completion = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] snapshot_name_template = snapshot-%s {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] split_loggers = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] state_path = /opt/stack/data/cinder {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] storage_availability_zone = nova {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] storage_protocol = iSCSI {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] syslog_log_facility = LOG_USER {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] target_helper = lioadm {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] target_ip_address = 192.168.122.11 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] target_port = 3260 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] target_protocol = iscsi {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] target_secondary_ip_addresses = [] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] trace_flags = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] transport_url = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] until_refresh = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] use_chap_auth = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] use_default_quota_class = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] use_journal = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] use_json = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] use_multipath_for_image_xfer = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] use_stderr = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] use_syslog = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] verify_glance_signatures = enabled {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] volume_api_class = cinder.volume.api.API {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] volume_backend_name = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] volume_clear = zero {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] volume_clear_ionice = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] volume_clear_size = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] volume_copy_bps_limit = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] volume_dd_blocksize = 1M {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] volume_name_template = volume-%s {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] volume_service_inithost_offload = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] volume_usage_audit_period = month {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] zoning_mode = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_concurrency.disable_process_locking = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.auth_section = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.auth_type = password {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.auth_version = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.cache = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.certfile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.include_service_catalog = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.insecure = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.interface = public {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.keyfile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcache_password = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcache_username = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.region_name = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.service_type = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.11/identity {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.backend = dogpile.cache.null {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.backend_argument = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.backend_expiration_time = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.config_prefix = cache.oslo {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.debug_cache_backend = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.enable_retry_client = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.enable_socket_keepalive = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.enabled = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.expiration_time = 600 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.hashclient_retry_attempts = 2 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.memcache_dead_retry = 300 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.memcache_pool_maxsize = 10 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.memcache_sasl_enabled = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.password = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.proxies = [] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.redis_db = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.redis_server = localhost:6379 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.retry_attempts = 2 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.retry_delay = 0.0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.socket_keepalive_count = 1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.socket_keepalive_idle = 1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.socket_keepalive_interval = 1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.socket_timeout = 1.0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.tls_allowed_ciphers = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.tls_cafile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.tls_certfile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.tls_enabled = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.tls_keyfile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cache.username = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] coordination.backend_url = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.asyncio_connection = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.asyncio_slave_connection = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.backend = sqlalchemy {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.connection = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.connection_debug = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.connection_parameters = {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.connection_recycle_time = 3600 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.connection_trace = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.db_inc_retry_interval = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.db_max_retries = 20 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.db_max_retry_interval = 10 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.db_retry_interval = 1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.max_overflow = 50 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.max_pool_size = 5 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.max_retries = 10 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.mysql_wsrep_sync_wait = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.pool_timeout = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.retry_interval = 10 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.slave_connection = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.sqlite_synchronous = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.synchronous_reader = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] database.use_db_reconnect = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_tracing.insecure = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] profiler.connection_string = messaging:// {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] profiler.enabled = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] profiler.es_doc_type = notification {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] profiler.es_scroll_size = 10000 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] profiler.es_scroll_time = 2m {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] profiler.filter_error_trace = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] profiler.hmac_keys = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87444) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] profiler.sentinel_service_name = mymaster {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] profiler.socket_timeout = 0.1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] profiler.trace_requests = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] profiler.trace_sqlalchemy = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] profiler_jaeger.process_tags = {} {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] profiler_jaeger.service_name_prefix = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] profiler_otlp.service_name_prefix = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_policy.enforce_new_defaults = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_policy.policy_default_rule = default {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.quobyte [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.quobyte [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_policy.policy_file = policy.yaml {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Running cmd (subprocess): mount.quobyte {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] privsep_osbrick.group = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] privsep_osbrick.helper_command = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] privsep_osbrick.user = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cinder_sys_admin.group = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cinder_sys_admin.helper_command = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] cinder_sys_admin.user = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] service_user.auth_section = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] service_user.auth_type = password {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] service_user.cafile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] service_user.certfile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] service_user.collect_timing = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] service_user.insecure = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] service_user.keyfile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] service_user.send_service_user_token = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] service_user.split_loggers = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] service_user.timeout = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] service_user.tls_ciphers = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] service_user.tls_min_version = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance.auth_section = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance.auth_type = password {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance.certfile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance.collect_timing = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance.insecure = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance.keyfile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance.region_name = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance.split_loggers = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance.timeout = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance.tls_ciphers = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] glance.tls_min_version = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.backend_availability_zone = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.chap_password = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.chap_username = {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.disk_geometry = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.driver_client_cert = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.driver_client_cert_key = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.driver_data_namespace = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.driver_use_ssl = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.extra_capabilities = {} {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.filter_function = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.goodness_function = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.iscsi_target_flags = {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.iscsi_write_cache = on {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.iser_helper = tgtadm {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.iser_ip_address = 192.168.122.11 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.iser_port = 3260 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.nas_host = {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.nas_login = admin {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.nas_mount_options = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.nas_password = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.nas_private_key = {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.nas_share_path = {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.num_shell_tries = 3 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.quobyte_volume_url = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.replication_device = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.report_discard_supported = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.reserved_percentage = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.target_helper = tgtadm {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.target_ip_address = 192.168.122.11 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.target_port = 3260 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.target_protocol = iscsi {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.trace_flags = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.unique_fqdn_network = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.use_chap_auth = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.volume_backend_name = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.volume_clear = zero {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.volume_clear_ionice = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.volume_clear_size = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_reports.file_event_handler = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_reports.log_dir = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.backend_availability_zone = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.backend_host = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.chap_password = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.chap_username = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.chiscsi_conf = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.disk_geometry = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.driver_client_cert = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.driver_data_namespace = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.driver_use_ssl = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.extra_capabilities = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.filter_function = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.goodness_function = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.iser_helper = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.iser_ip_address = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.iser_port = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.iser_target_prefix = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack quobyte-client[87445]: Reading configuration file: /etc/quobyte/client.cfg Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.nas_host = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.nas_login = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack quobyte-client[87445]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.nas_mount_options = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.nas_password = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.nas_private_key = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.nas_share_path = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.nas_ssh_port = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] CMD "mount.quobyte" returned: 1 in 0.053s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.num_shell_tries = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.nvmet_port_id = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.replication_device = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.report_discard_supported = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.reserved_percentage = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.scst_target_driver = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.storage_protocol = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.target_helper = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.target_ip_address = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.target_port = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.target_prefix = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.target_protocol = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.trace_flags = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.use_chap_auth = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.volume_clear = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.volume_clear_size = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] QuobyteHD.volumes_dir = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.ssl = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_notifications.driver = [] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_notifications.retry = -1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:40:51 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] key_manager.fixed_key = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.barbican_api_version = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.barbican_endpoint = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.barbican_endpoint_type = public {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.barbican_region_name = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.cafile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.certfile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.collect_timing = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.insecure = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.keyfile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.number_of_retries = 60 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.retry_delay = 1 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.send_service_user_token = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.split_loggers = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.timeout = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.tls_ciphers = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.tls_min_version = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.verify_ssl = True {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican.verify_ssl_path = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican_service_user.auth_section = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican_service_user.auth_type = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican_service_user.cafile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican_service_user.certfile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican_service_user.collect_timing = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican_service_user.insecure = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican_service_user.keyfile = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican_service_user.split_loggers = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican_service_user.timeout = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican_service_user.tls_ciphers = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] barbican_service_user.tls_min_version = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] vault.approle_role_id = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] vault.approle_secret_id = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] vault.auth_method = approle {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] vault.auth_path = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] vault.kv_mountpoint = secret {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] vault.kv_path = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] vault.kv_version = 2 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] vault.namespace = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] vault.root_token_id = **** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] vault.ssl_ca_crt_file = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] vault.timeout = 60.0 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] vault.token_file = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] vault.token_role = None {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] vault.use_ssl = False {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 07 13:40:51 devstack cinder-volume[87352]: DEBUG oslo_service.backend._eventlet.service [None req-c57c5b92-f62a-4a5a-b827-e52d9c89de84 None None] ******************************************************************************** {{(pid=87352) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 07 13:40:52 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.231s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:52 devstack cinder-volume[87444]: INFO cinder.volume.driver [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Driver hasn't implemented _init_vendor_properties() Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG cinder.volume.driver [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5802955627441, 'free_capacity_gb': 1773.5802955627441, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87444) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG oslo_db.sqlalchemy.engines [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87444) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writer thread running {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG cinder.db.api [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Building query based on filter {{(pid=87444) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87444) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:52 devstack cinder-volume[87444]: INFO cinder.keymgr.migration [None req-74e6ed83-e2e5-463a-be5a-3cff18bc83a0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 07 13:40:52 devstack sudo[87457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:40:52 devstack sudo[87457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:40:52 devstack sudo[87457]: pam_unix(sudo:session): session closed for user root Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.230s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:40:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Driver initialization completed successfully. Sep 07 13:40:52 devstack cinder-volume[87444]: INFO cinder.manager [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Initiating service 3 cleanup Sep 07 13:40:52 devstack cinder-volume[87444]: INFO cinder.manager [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Service 3 cleanup completed. Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG cinder.service [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Creating RPC server for service cinder-volume {{(pid=87444) start /opt/stack/cinder/cinder/service.py:231}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG cinder.service [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87444) start /opt/stack/cinder/cinder/service.py:237}} Sep 07 13:40:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:40:52 devstack sudo[87468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:40:52 devstack sudo[87468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:40:52 devstack sudo[87468]: pam_unix(sudo:session): session closed for user root Sep 07 13:40:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.236s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:40:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-23c6b5f1-f90a-4c0e-b3ac-3fca20670389 None None] Driver post RPC initialization completed successfully. Sep 07 13:41:01 devstack cinder-volume[87352]: DEBUG dbcounter [-] [87352] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87352) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:41:02 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:41:02 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=3 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:41:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:41:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 6 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:41:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:42:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:42:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:42:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:42:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:42:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:42:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:42:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:29 devstack sudo[87992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:42:29 devstack sudo[87992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:30 devstack sudo[87992]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.233s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:42:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:42:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 6 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:42:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Flow 'volume_create_manager' (679c91f8-c748-4f2c-a0c5-fdb416837609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44789960-d5ed-4c53-80f3-350861eb7e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44789960-d5ed-4c53-80f3-350861eb7e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1800545811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a7941c-e2bd-4075-b75a-01da98481e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71da8808e71a4bc9a9a3166ea5a83974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:42:37Z,use_quota=True,user_id='3633133ee46a44d3b9b6019bd58f202d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72fd3484-07a2-49dc-b42b-7edf9271421f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72fd3484-07a2-49dc-b42b-7edf9271421f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84acac23-56c2-4079-a10c-4e7e2d020206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84acac23-56c2-4079-a10c-4e7e2d020206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88a7941c-e2bd-4075-b75a-01da98481e14', 'volume_name': 'volume-88a7941c-e2bd-4075-b75a-01da98481e14', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d4b7c0-7a54-4d3d-b10f-5d9abd329177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d4b7c0-7a54-4d3d-b10f-5d9abd329177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c3d8e6-4eef-4cbe-9bfb-2fc50f1f0153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:42:37 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Volume 88a7941c-e2bd-4075-b75a-01da98481e14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88a7941c-e2bd-4075-b75a-01da98481e14', 'volume_size': 1} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1800545811',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a7941c-e2bd-4075-b75a-01da98481e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71da8808e71a4bc9a9a3166ea5a83974',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:42:37Z,use_quota=True,user_id='3633133ee46a44d3b9b6019bd58f202d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Creating volume 88a7941c-e2bd-4075-b75a-01da98481e14 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:42:37 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:42:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:37 devstack sudo[88047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14 1073741824 Sep 07 13:42:37 devstack sudo[88047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:38 devstack sudo[88047]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14 1073741824" returned: 0 in 0.686s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:38 devstack sudo[88366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14 Sep 07 13:42:38 devstack sudo[88366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:38 devstack sudo[88366]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14" returned: 0 in 0.290s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:42:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:42:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21c3d8e6-4eef-4cbe-9bfb-2fc50f1f0153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88a7941c-e2bd-4075-b75a-01da98481e14', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:42:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e626a9-29cc-4245-8ee1-fc2ca3f5e512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:42:38 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Volume volume-88a7941c-e2bd-4075-b75a-01da98481e14 (88a7941c-e2bd-4075-b75a-01da98481e14): created successfully Sep 07 13:42:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5e626a9-29cc-4245-8ee1-fc2ca3f5e512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:42:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Flow 'volume_create_manager' (679c91f8-c748-4f2c-a0c5-fdb416837609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:42:38 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-709c6dba-ea6b-4d2c-ab2a-30a07a879d65 req-4167adef-91a4-4ed5-b0f5-2aed5fe2bb08 tempest-VolumesSnapshotsTestJSON-707760452 None] Created volume successfully. Sep 07 13:42:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:42:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:42:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] Creating offline snapshot 609b9c1f-487e-4561-9add-0701a4c7963c of volume 88a7941c-e2bd-4075-b75a-01da98481e14 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:42:39 devstack cinder-volume[87444]: INFO oslo.privsep.daemon [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_d9_l4zh/privsep.sock'] Sep 07 13:42:39 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_d9_l4zh/privsep.sock Sep 07 13:42:39 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:40 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 07 13:42:40 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 07 13:42:40 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 07 13:42:40 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: Sep 07 13:42:40 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 07 13:42:40 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 07 13:42:40 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 07 13:42:40 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: Sep 07 13:42:40 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 07 13:42:40 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:40 devstack cinder-volume[87444]: INFO oslo.privsep.daemon [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] Spawned new privsep daemon via rootwrap Sep 07 13:42:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] Accepted privsep connection to /tmp/tmp_d9_l4zh/privsep.sock {{(pid=87444) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 07 13:42:40 devstack cinder-volume[87444]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 07 13:42:40 devstack cinder-volume[87444]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 07 13:42:40 devstack cinder-volume[87444]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 07 13:42:40 devstack cinder-volume[87444]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88374 Sep 07 13:42:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[07aa29b6-7334-40c4-b361-6c6932ea0717]: (2,) {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:42:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95d0837-9d3c-452a-83aa-5035b9885c6a]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:42:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:41 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14 Sep 07 13:42:41 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:41 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14" returned: 0 in 0.453s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:41 devstack sudo[88381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c 1G Sep 07 13:42:41 devstack sudo[88381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:41 devstack sudo[88381]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c 1G" returned: 0 in 0.445s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a7941c-e2bd-4075-b75a-01da98481e14 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:41 devstack sudo[88388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a7941c-e2bd-4075-b75a-01da98481e14 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c Sep 07 13:42:41 devstack sudo[88388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:42 devstack sudo[88388]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a7941c-e2bd-4075-b75a-01da98481e14 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c" returned: 0 in 0.331s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:42 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c is being set with open permissions: ugo+rw Sep 07 13:42:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:42 devstack sudo[88395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c Sep 07 13:42:42 devstack sudo[88395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:42 devstack sudo[88395]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c" returned: 0 in 0.344s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:42 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.info Sep 07 13:42:42 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:42 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.info" returned: 0 in 0.313s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:42 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.info is being set with open permissions: ugo+rw Sep 07 13:42:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:42 devstack sudo[88401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.info Sep 07 13:42:42 devstack sudo[88401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:43 devstack sudo[88401]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.info" returned: 0 in 0.300s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.512s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:42:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-75c97518-96a5-4b43-9432-27fa52b491bf req-def9d869-6d64-4aad-a666-a1f811f31ceb tempest-VolumesSnapshotsTestJSON-707760452 None] Create snapshot completed successfully Sep 07 13:42:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Acquiring lock "cinder-609b9c1f-487e-4561-9add-0701a4c7963c-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:42:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "cinder-609b9c1f-487e-4561-9add-0701a4c7963c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:42:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Acquiring lock "cinder-quobyte-88a7941c-e2bd-4075-b75a-01da98481e14" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:42:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "cinder-quobyte-88a7941c-e2bd-4075-b75a-01da98481e14" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:42:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Acquiring lock "cinder-quobyte-609b9c1f-487e-4561-9add-0701a4c7963c" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:42:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "cinder-quobyte-609b9c1f-487e-4561-9add-0701a4c7963c" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:42:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Deleting offline snapshot 609b9c1f-487e-4561-9add-0701a4c7963c of volume 88a7941c-e2bd-4075-b75a-01da98481e14 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:42:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] snapshot_file for this snap is: volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:42:44 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a09cd6-6a2c-40b5-bde2-8c3c5389910d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:42:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:44 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c Sep 07 13:42:44 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:44 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c" returned: 0 in 0.423s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88a7941c-e2bd-4075-b75a-01da98481e14(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:42:44 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abdfb83-b6f6-42be-99e3-1c84db53600a]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:42:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:45 devstack sudo[88410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14 Sep 07 13:42:45 devstack sudo[88410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:45 devstack sudo[88410]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14" returned: 0 in 0.411s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:45 devstack sudo[88416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c Sep 07 13:42:45 devstack sudo[88416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:45 devstack sudo[88416]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c" returned: 0 in 0.396s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:45 devstack sudo[88421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c Sep 07 13:42:45 devstack sudo[88421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:46 devstack sudo[88421]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14.609b9c1f-487e-4561-9add-0701a4c7963c" returned: 0 in 0.284s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "cinder-quobyte-609b9c1f-487e-4561-9add-0701a4c7963c" released by "_delete_snapshot" :: held 1.641s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:42:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "cinder-quobyte-88a7941c-e2bd-4075-b75a-01da98481e14" released by "delete_snapshot" :: held 1.671s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:42:46 devstack cinder-volume[87444]: WARNING cinder.quota [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:42:46 devstack cinder-volume[87444]: WARNING cinder.quota [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:42:46 devstack cinder-volume[87444]: DEBUG cinder.quota [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Created reservations ['a3fe18c6-92e4-4ca8-b47e-66c5f4a1b510', 'd1bf4c43-5d22-45df-89fb-d8ccfd2dfa6e', 'ea8f167d-c298-47ab-833a-625356b27e40', 'f423c8a1-5df6-4c1d-b220-f5a2955b7d43'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:42:46 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Delete snapshot completed successfully. Sep 07 13:42:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-5da974b0-32fa-4956-9b2b-82b20ddcd744 req-43aaa67a-aa34-4271-9843-91436aa34a87 tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "cinder-609b9c1f-487e-4561-9add-0701a4c7963c-delete_snapshot" released by "delete_snapshot" :: held 1.905s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:42:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Acquiring lock "cinder-88a7941c-e2bd-4075-b75a-01da98481e14-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:42:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "cinder-88a7941c-e2bd-4075-b75a-01da98481e14-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:42:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Acquiring lock "cinder-quobyte-88a7941c-e2bd-4075-b75a-01da98481e14" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:42:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "cinder-quobyte-88a7941c-e2bd-4075-b75a-01da98481e14" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:42:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[819f5313-b97b-43b0-853b-75e97275fc6d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:42:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:47 devstack sudo[88424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14 Sep 07 13:42:47 devstack sudo[88424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:47 devstack sudo[88424]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14" returned: 0 in 0.398s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:47 devstack sudo[88429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14 Sep 07 13:42:47 devstack sudo[88429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:47 devstack sudo[88429]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-88a7941c-e2bd-4075-b75a-01da98481e14" returned: 0 in 0.279s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "cinder-quobyte-88a7941c-e2bd-4075-b75a-01da98481e14" released by "delete_volume" :: held 0.775s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:42:47 devstack cinder-volume[87444]: WARNING cinder.quota [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:42:47 devstack cinder-volume[87444]: DEBUG cinder.quota [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Created reservations ['a81b50c4-b9f3-4d37-913e-c134ec0af532', 'f5bfea02-9296-47be-8d65-5739589c5788', '9ca5fdb9-c21d-451b-93e4-a72ef87f1bbf', '72c2bb41-069b-4bf5-a625-b5a4e7d0a01b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:47 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:42:47 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:48 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.342s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:48 devstack cinder-volume[87444]: DEBUG cinder.manager [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:42:48 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Deleted volume successfully. Sep 07 13:42:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-ae611272-787c-4829-8ddb-1ef3b0081b41 req-a523a492-4de3-437e-9773-68bbaff0fe94 tempest-VolumesSnapshotsTestJSON-707760452 None] Lock "cinder-88a7941c-e2bd-4075-b75a-01da98481e14-delete_volume" released by "delete_volume" :: held 1.395s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Flow 'volume_create_manager' (b65c07cc-e0a6-4c94-a107-e5acf47b56df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2b19ff-22de-4dd0-84d9-ff753c0bda37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d2b19ff-22de-4dd0-84d9-ff753c0bda37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1985855700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5576de-b706-484e-aa6a-133bdff79fa7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4847adf1dc974e37a2080d3d311d9142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:42:59Z,use_quota=True,user_id='e60844afa0e845489734c3088afc987c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e8b0ca-75b3-42cc-88c0-e8bab2f4d700) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e8b0ca-75b3-42cc-88c0-e8bab2f4d700) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c97a68c3-9caf-4f25-a6e0-2145eed33135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c97a68c3-9caf-4f25-a6e0-2145eed33135) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5576de-b706-484e-aa6a-133bdff79fa7', 'volume_name': 'volume-1e5576de-b706-484e-aa6a-133bdff79fa7', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f095288-6df5-4478-8e22-72be35cff763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f095288-6df5-4478-8e22-72be35cff763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef371d0-cd11-4a0f-b12d-6878f797b1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:42:59 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Volume 1e5576de-b706-484e-aa6a-133bdff79fa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5576de-b706-484e-aa6a-133bdff79fa7', 'volume_size': 1} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:42:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1985855700',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5576de-b706-484e-aa6a-133bdff79fa7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4847adf1dc974e37a2080d3d311d9142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:42:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:42:59Z,use_quota=True,user_id='e60844afa0e845489734c3088afc987c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Creating volume 1e5576de-b706-484e-aa6a-133bdff79fa7 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:42:59 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1e5576de-b706-484e-aa6a-133bdff79fa7 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:59 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1e5576de-b706-484e-aa6a-133bdff79fa7 1073741824 Sep 07 13:42:59 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:42:59 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1e5576de-b706-484e-aa6a-133bdff79fa7 1073741824" returned: 0 in 0.459s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:42:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1e5576de-b706-484e-aa6a-133bdff79fa7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:42:59 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1e5576de-b706-484e-aa6a-133bdff79fa7 Sep 07 13:42:59 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:00 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1e5576de-b706-484e-aa6a-133bdff79fa7" returned: 0 in 0.411s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:43:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef371d0-cd11-4a0f-b12d-6878f797b1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5576de-b706-484e-aa6a-133bdff79fa7', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd823e5-5250-4075-8ee8-35b591df250d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:00 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Volume volume-1e5576de-b706-484e-aa6a-133bdff79fa7 (1e5576de-b706-484e-aa6a-133bdff79fa7): created successfully Sep 07 13:43:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bd823e5-5250-4075-8ee8-35b591df250d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Flow 'volume_create_manager' (b65c07cc-e0a6-4c94-a107-e5acf47b56df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:00 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-790967bf-530b-4715-b5a6-d1ec939f09cc tempest-VolumesTestJSON-2026994912 None] Created volume successfully. Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Flow 'volume_create_manager' (07ede427-f249-4f33-bd9f-c4fdddd88924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c3049c-df46-4643-bc39-da5a67faaec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c3049c-df46-4643-bc39-da5a67faaec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1805947290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94fe378-7506-40fa-a4fb-4c423ff84ded,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4847adf1dc974e37a2080d3d311d9142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:02Z,use_quota=True,user_id='e60844afa0e845489734c3088afc987c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcf6930-d803-4a50-a4e2-689f626d282e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dcf6930-d803-4a50-a4e2-689f626d282e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3b00e4-658c-4c83-b4fe-8746fa0b464c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb3b00e4-658c-4c83-b4fe-8746fa0b464c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd94fe378-7506-40fa-a4fb-4c423ff84ded', 'volume_name': 'volume-d94fe378-7506-40fa-a4fb-4c423ff84ded', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14ee83a-2085-483a-b109-5c837f54b24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b14ee83a-2085-483a-b109-5c837f54b24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175dc85e-7522-4e80-a75b-aab3d4d5da91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:02 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Volume d94fe378-7506-40fa-a4fb-4c423ff84ded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d94fe378-7506-40fa-a4fb-4c423ff84ded', 'volume_size': 1} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:43:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1805947290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d94fe378-7506-40fa-a4fb-4c423ff84ded,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4847adf1dc974e37a2080d3d311d9142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:02Z,use_quota=True,user_id='e60844afa0e845489734c3088afc987c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Creating volume d94fe378-7506-40fa-a4fb-4c423ff84ded {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:43:02 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d94fe378-7506-40fa-a4fb-4c423ff84ded 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:02 devstack sudo[88462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d94fe378-7506-40fa-a4fb-4c423ff84ded 1073741824 Sep 07 13:43:02 devstack sudo[88462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:02 devstack sudo[88462]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d94fe378-7506-40fa-a4fb-4c423ff84ded 1073741824" returned: 0 in 0.504s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d94fe378-7506-40fa-a4fb-4c423ff84ded {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:02 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d94fe378-7506-40fa-a4fb-4c423ff84ded Sep 07 13:43:02 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:03 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d94fe378-7506-40fa-a4fb-4c423ff84ded" returned: 0 in 0.296s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] <== create_volume: return (853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:43:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175dc85e-7522-4e80-a75b-aab3d4d5da91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d94fe378-7506-40fa-a4fb-4c423ff84ded', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a0fa03-362c-4697-b051-9f1e0921fc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:03 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Volume volume-d94fe378-7506-40fa-a4fb-4c423ff84ded (d94fe378-7506-40fa-a4fb-4c423ff84ded): created successfully Sep 07 13:43:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a0fa03-362c-4697-b051-9f1e0921fc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Flow 'volume_create_manager' (07ede427-f249-4f33-bd9f-c4fdddd88924) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:03 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fcdb8c80-1ea2-4d4e-8855-69cec9ad3a43 tempest-VolumesTestJSON-2026994912 None] Created volume successfully. Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Flow 'volume_create_manager' (4038d83b-f3a3-4a9b-b3f4-71c465e349b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f2582c-2130-42cf-87a1-6c94fd694f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f2582c-2130-42cf-87a1-6c94fd694f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1986181106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906fa5d7-6dd9-4da4-91e7-0c8718a0366b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4847adf1dc974e37a2080d3d311d9142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:05Z,use_quota=True,user_id='e60844afa0e845489734c3088afc987c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68fdecf-39a5-4787-ae4f-c6961475df68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68fdecf-39a5-4787-ae4f-c6961475df68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70932c6-353b-48a7-bdf2-7a29bc9d15d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c70932c6-353b-48a7-bdf2-7a29bc9d15d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '906fa5d7-6dd9-4da4-91e7-0c8718a0366b', 'volume_name': 'volume-906fa5d7-6dd9-4da4-91e7-0c8718a0366b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a913ebd5-5e8d-4064-b571-99a7c58d4d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a913ebd5-5e8d-4064-b571-99a7c58d4d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ccdd93-62f2-43e9-9461-2a1f16d5a037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:04 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Volume 906fa5d7-6dd9-4da4-91e7-0c8718a0366b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-906fa5d7-6dd9-4da4-91e7-0c8718a0366b', 'volume_size': 1} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:43:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1986181106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=906fa5d7-6dd9-4da4-91e7-0c8718a0366b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4847adf1dc974e37a2080d3d311d9142',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:05Z,use_quota=True,user_id='e60844afa0e845489734c3088afc987c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Creating volume 906fa5d7-6dd9-4da4-91e7-0c8718a0366b {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:43:04 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:43:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-906fa5d7-6dd9-4da4-91e7-0c8718a0366b 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:04 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-906fa5d7-6dd9-4da4-91e7-0c8718a0366b 1073741824 Sep 07 13:43:04 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:05 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-906fa5d7-6dd9-4da4-91e7-0c8718a0366b 1073741824" returned: 0 in 0.580s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-906fa5d7-6dd9-4da4-91e7-0c8718a0366b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:05 devstack sudo[88478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-906fa5d7-6dd9-4da4-91e7-0c8718a0366b Sep 07 13:43:05 devstack sudo[88478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:05 devstack sudo[88478]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-906fa5d7-6dd9-4da4-91e7-0c8718a0366b" returned: 0 in 0.312s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:43:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ccdd93-62f2-43e9-9461-2a1f16d5a037) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-906fa5d7-6dd9-4da4-91e7-0c8718a0366b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fa3d8f-c0f3-40ca-9067-e75fa526f92e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:05 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Volume volume-906fa5d7-6dd9-4da4-91e7-0c8718a0366b (906fa5d7-6dd9-4da4-91e7-0c8718a0366b): created successfully Sep 07 13:43:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6fa3d8f-c0f3-40ca-9067-e75fa526f92e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Flow 'volume_create_manager' (4038d83b-f3a3-4a9b-b3f4-71c465e349b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:05 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fe7579b6-0584-49df-85e1-e3bc13b51de6 tempest-VolumesTestJSON-2026994912 None] Created volume successfully. Sep 07 13:43:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Acquiring lock "cinder-906fa5d7-6dd9-4da4-91e7-0c8718a0366b-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:43:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Lock "cinder-906fa5d7-6dd9-4da4-91e7-0c8718a0366b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:43:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Acquiring lock "cinder-quobyte-906fa5d7-6dd9-4da4-91e7-0c8718a0366b" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:43:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Lock "cinder-quobyte-906fa5d7-6dd9-4da4-91e7-0c8718a0366b" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:43:08 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f7297e-b02c-4747-8740-f78c3f3e36c7]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:43:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-906fa5d7-6dd9-4da4-91e7-0c8718a0366b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:08 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-906fa5d7-6dd9-4da4-91e7-0c8718a0366b Sep 07 13:43:08 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:08 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-906fa5d7-6dd9-4da4-91e7-0c8718a0366b" returned: 0 in 0.461s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-906fa5d7-6dd9-4da4-91e7-0c8718a0366b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:09 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-906fa5d7-6dd9-4da4-91e7-0c8718a0366b Sep 07 13:43:09 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:09 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-906fa5d7-6dd9-4da4-91e7-0c8718a0366b" returned: 0 in 0.298s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Lock "cinder-quobyte-906fa5d7-6dd9-4da4-91e7-0c8718a0366b" released by "delete_volume" :: held 0.820s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Created reservations ['8095563b-364b-453a-b251-786452235940', '5b2b093d-78b6-454f-b6ac-3340063b5740', 'bc509cf0-7094-4936-89fa-f04e10b5e8ff', 'e6538c9c-c868-42ba-87fa-5c636942657d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:09 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:43:09 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Acquiring lock "cinder-d94fe378-7506-40fa-a4fb-4c423ff84ded-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Lock "cinder-d94fe378-7506-40fa-a4fb-4c423ff84ded-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Acquiring lock "cinder-quobyte-d94fe378-7506-40fa-a4fb-4c423ff84ded" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Lock "cinder-quobyte-d94fe378-7506-40fa-a4fb-4c423ff84ded" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda3141e-0b3b-4120-83f8-3b787f62dece]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d94fe378-7506-40fa-a4fb-4c423ff84ded {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:09 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.390s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:43:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Deleted volume successfully. Sep 07 13:43:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-39d49119-1c65-4487-b7f9-58189b83b680 tempest-VolumesTestJSON-2026994912 None] Lock "cinder-906fa5d7-6dd9-4da4-91e7-0c8718a0366b-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:43:09 devstack sudo[88492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d94fe378-7506-40fa-a4fb-4c423ff84ded Sep 07 13:43:09 devstack sudo[88492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:10 devstack sudo[88492]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d94fe378-7506-40fa-a4fb-4c423ff84ded" returned: 0 in 0.452s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d94fe378-7506-40fa-a4fb-4c423ff84ded {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:10 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d94fe378-7506-40fa-a4fb-4c423ff84ded Sep 07 13:43:10 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:10 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d94fe378-7506-40fa-a4fb-4c423ff84ded" returned: 0 in 0.270s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Lock "cinder-quobyte-d94fe378-7506-40fa-a4fb-4c423ff84ded" released by "delete_volume" :: held 0.775s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Created reservations ['19f3594e-4980-42ec-a871-88520c4552f1', '032aea6c-d0fc-43d4-958d-b6a09f0fc992', '58d20624-9af6-4053-83f8-d33951a11b97', 'd5d1bbb1-a7a0-413d-8992-6b00821752b7'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:10 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:43:10 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Acquiring lock "cinder-1e5576de-b706-484e-aa6a-133bdff79fa7-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Lock "cinder-1e5576de-b706-484e-aa6a-133bdff79fa7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:43:10 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.268s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Acquiring lock "cinder-quobyte-1e5576de-b706-484e-aa6a-133bdff79fa7" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:43:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Deleted volume successfully. Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9a94dfd8-ec77-4365-944c-d5189fde3439 tempest-VolumesTestJSON-2026994912 None] Lock "cinder-d94fe378-7506-40fa-a4fb-4c423ff84ded-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:43:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Lock "cinder-quobyte-1e5576de-b706-484e-aa6a-133bdff79fa7" acquired by "delete_volume" :: waited 0.044s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:43:11 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b246b21-6421-43e9-9c4a-b91785622ffe]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:43:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1e5576de-b706-484e-aa6a-133bdff79fa7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:11 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1e5576de-b706-484e-aa6a-133bdff79fa7 Sep 07 13:43:11 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:11 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1e5576de-b706-484e-aa6a-133bdff79fa7" returned: 0 in 0.392s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1e5576de-b706-484e-aa6a-133bdff79fa7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:11 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1e5576de-b706-484e-aa6a-133bdff79fa7 Sep 07 13:43:11 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:11 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1e5576de-b706-484e-aa6a-133bdff79fa7" returned: 0 in 0.323s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Lock "cinder-quobyte-1e5576de-b706-484e-aa6a-133bdff79fa7" released by "delete_volume" :: held 0.767s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:43:11 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Created reservations ['200e7e50-e4b4-4b16-8c78-9f6ff3b8a1af', '9efcd8d5-c9f6-42d3-8885-05dae0c780a9', 'b3b1060c-b0b7-467a-9680-faeeabaa8261', '0325cfe7-e7f8-49df-8603-a469fef662e4'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:43:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:11 devstack sudo[88513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:43:11 devstack sudo[88513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:12 devstack sudo[88513]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.340s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:12 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:43:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Deleted volume successfully. Sep 07 13:43:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-61c4bc39-d106-4c44-80f7-91d6cab947bf tempest-VolumesTestJSON-2026994912 None] Lock "cinder-1e5576de-b706-484e-aa6a-133bdff79fa7-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Flow 'volume_create_manager' (e42e6370-f853-4c29-bf52-f4486c5818f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1914cb61-9136-45b4-93b4-475f6ce2c0e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1914cb61-9136-45b4-93b4-475f6ce2c0e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1083501489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc0ed93-bcfd-4b50-adc2-ca0677257a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e339920e414007a22e88bc60f8a6b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:19Z,use_quota=True,user_id='d808158bd7ed4528b6eee3f201188112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee09d90-7be9-45b3-a64e-3f1626688af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee09d90-7be9-45b3-a64e-3f1626688af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c258068-1d6a-4602-8ddd-04485eeed8ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c258068-1d6a-4602-8ddd-04485eeed8ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bc0ed93-bcfd-4b50-adc2-ca0677257a3e', 'volume_name': 'volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58f6018-5600-48a2-b039-3477343270b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58f6018-5600-48a2-b039-3477343270b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b662b9e0-b520-475c-9392-1e13ade6a602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:19 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Volume 1bc0ed93-bcfd-4b50-adc2-ca0677257a3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e', 'volume_size': 1} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:43:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1083501489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bc0ed93-bcfd-4b50-adc2-ca0677257a3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04e339920e414007a22e88bc60f8a6b9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:19Z,use_quota=True,user_id='d808158bd7ed4528b6eee3f201188112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Creating volume 1bc0ed93-bcfd-4b50-adc2-ca0677257a3e {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:43:19 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:43:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:19 devstack sudo[88516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e 1073741824 Sep 07 13:43:19 devstack sudo[88516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:19 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9a9d8db6-61e1-442e-a6c3-c03b9531aacf tempest-GroupsTest-700019740 None] Group tempest-Group1-1082358969: creating Sep 07 13:43:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9a9d8db6-61e1-442e-a6c3-c03b9531aacf tempest-GroupsTest-700019740 None] Group tempest-Group1-1082358969: created successfully Sep 07 13:43:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9a9d8db6-61e1-442e-a6c3-c03b9531aacf tempest-GroupsTest-700019740 None] Create group completed successfully. Sep 07 13:43:20 devstack sudo[88516]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e 1073741824" returned: 0 in 0.619s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:20 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e Sep 07 13:43:20 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:20 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e" returned: 0 in 0.307s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:43:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b662b9e0-b520-475c-9392-1e13ade6a602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (879892b4-26f2-469c-ad4f-e4900f587082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:20 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Volume volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e (1bc0ed93-bcfd-4b50-adc2-ca0677257a3e): created successfully Sep 07 13:43:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (879892b4-26f2-469c-ad4f-e4900f587082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Flow 'volume_create_manager' (e42e6370-f853-4c29-bf52-f4486c5818f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-db06d7a0-4743-46fe-87ef-728e9f723485 tempest-TaggedAttachmentsTest-413219049 None] Created volume successfully. Sep 07 13:43:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f4a1f178-0e4d-42ad-9fa3-dcf356c4c3a2 tempest-GroupsTest-700019740 None] Group tempest-Group2-1175011184: creating Sep 07 13:43:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f4a1f178-0e4d-42ad-9fa3-dcf356c4c3a2 tempest-GroupsTest-700019740 None] Group tempest-Group2-1175011184: created successfully Sep 07 13:43:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f4a1f178-0e4d-42ad-9fa3-dcf356c4c3a2 tempest-GroupsTest-700019740 None] Create group completed successfully. Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Flow 'volume_create_manager' (544c6c74-40af-49dc-83a0-836b100bfed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff52b3b-507f-4928-9839-a52e1544306b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ff52b3b-507f-4928-9839-a52e1544306b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-18511183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5a44e6d-8ee8-4459-9e49-02c3f05399cc,host='devstack@QuobyteHD#QuobyteHD',id=8d899acb-1723-4ec1-80c2-2faabff3f73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7123069894d80aeb3ce91acd118d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:23Z,use_quota=True,user_id='f15763efb91849aba9d89fca98aa2799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fdf5939-68a0-4665-8517-c5f3f8204330),volume_type_id=9fdf5939-68a0-4665-8517-c5f3f8204330)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8ead66-6333-41be-90e5-840adce5829b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba8ead66-6333-41be-90e5-840adce5829b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a2508b-7508-4d08-bac6-f58c12acbd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a2508b-7508-4d08-bac6-f58c12acbd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d899acb-1723-4ec1-80c2-2faabff3f73c', 'volume_name': 'volume-8d899acb-1723-4ec1-80c2-2faabff3f73c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2c5db7-24d1-4709-a4e7-1eb6135198d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c2c5db7-24d1-4709-a4e7-1eb6135198d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04576601-3c3b-4eda-b852-de25feddf917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:23 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Volume 8d899acb-1723-4ec1-80c2-2faabff3f73c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d899acb-1723-4ec1-80c2-2faabff3f73c', 'volume_size': 1} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d5a44e6d-8ee8-4459-9e49-02c3f05399cc,created_at=2026-09-07T11:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-18511183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d5a44e6d-8ee8-4459-9e49-02c3f05399cc,host='devstack@QuobyteHD#QuobyteHD',id=8d899acb-1723-4ec1-80c2-2faabff3f73c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7123069894d80aeb3ce91acd118d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:23Z,use_quota=True,user_id='f15763efb91849aba9d89fca98aa2799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9fdf5939-68a0-4665-8517-c5f3f8204330),volume_type_id=9fdf5939-68a0-4665-8517-c5f3f8204330)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Creating volume 8d899acb-1723-4ec1-80c2-2faabff3f73c {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:43:23 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8d899acb-1723-4ec1-80c2-2faabff3f73c 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:23 devstack sudo[88527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8d899acb-1723-4ec1-80c2-2faabff3f73c 1073741824 Sep 07 13:43:23 devstack sudo[88527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:23 devstack sudo[88527]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8d899acb-1723-4ec1-80c2-2faabff3f73c 1073741824" returned: 0 in 0.476s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8d899acb-1723-4ec1-80c2-2faabff3f73c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:23 devstack sudo[88533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8d899acb-1723-4ec1-80c2-2faabff3f73c Sep 07 13:43:23 devstack sudo[88533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:23 devstack sudo[88533]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8d899acb-1723-4ec1-80c2-2faabff3f73c" returned: 0 in 0.257s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04576601-3c3b-4eda-b852-de25feddf917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d899acb-1723-4ec1-80c2-2faabff3f73c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef0fca6-2a82-4e91-90fd-2969c49b6744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:23 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Volume volume-8d899acb-1723-4ec1-80c2-2faabff3f73c (8d899acb-1723-4ec1-80c2-2faabff3f73c): created successfully Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef0fca6-2a82-4e91-90fd-2969c49b6744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Flow 'volume_create_manager' (544c6c74-40af-49dc-83a0-836b100bfed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:23 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-323d6e3f-d64f-4a4a-bd03-7a0c752ae2c9 tempest-GroupsTest-700019740 None] Created volume successfully. Sep 07 13:43:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Acquiring lock "cinder-quobyte-8d899acb-1723-4ec1-80c2-2faabff3f73c" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:43:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Lock "cinder-quobyte-8d899acb-1723-4ec1-80c2-2faabff3f73c" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:43:25 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4603e3c6-915d-4ec7-bec8-25fb551f4f29]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:43:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8d899acb-1723-4ec1-80c2-2faabff3f73c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:25 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8d899acb-1723-4ec1-80c2-2faabff3f73c Sep 07 13:43:25 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:25 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8d899acb-1723-4ec1-80c2-2faabff3f73c" returned: 0 in 0.537s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8d899acb-1723-4ec1-80c2-2faabff3f73c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:25 devstack sudo[88542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8d899acb-1723-4ec1-80c2-2faabff3f73c Sep 07 13:43:25 devstack sudo[88542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:26 devstack sudo[88542]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8d899acb-1723-4ec1-80c2-2faabff3f73c" returned: 0 in 0.260s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Lock "cinder-quobyte-8d899acb-1723-4ec1-80c2-2faabff3f73c" released by "delete_volume" :: held 0.850s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Created reservations ['61bf3701-2a8b-4529-8a20-711b57be6339'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:43:26 devstack cinder-volume[87444]: WARNING cinder.quota [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-127169939 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-127169939, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:43:26 devstack cinder-volume[87444]: WARNING cinder.quota [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-127169939 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-127169939, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Created reservations ['4bfd601c-8095-4ebf-b3dc-42bc18951aa1', '46eceb61-3cc8-4374-9ff0-c49832e84d98', 'ff77df86-fb4a-4a68-8070-97ff9c48c308', '4fc42aae-01d6-4c1d-a127-9f7a60b9f96d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:26 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:43:26 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:26 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.426s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:43:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-44947cbf-b8f8-4c6f-a7a9-b592177e5066 tempest-GroupsTest-700019740 None] Delete group completed successfully. Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-654ebb27-3d39-4248-a3ab-08f84477ac15 tempest-GroupsTest-700019740 None] Created reservations ['49101a24-e5d9-4e91-bcfc-8b9e27f775f2'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-654ebb27-3d39-4248-a3ab-08f84477ac15 tempest-GroupsTest-700019740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-654ebb27-3d39-4248-a3ab-08f84477ac15 tempest-GroupsTest-700019740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-654ebb27-3d39-4248-a3ab-08f84477ac15 tempest-GroupsTest-700019740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-654ebb27-3d39-4248-a3ab-08f84477ac15 tempest-GroupsTest-700019740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-654ebb27-3d39-4248-a3ab-08f84477ac15 tempest-GroupsTest-700019740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-654ebb27-3d39-4248-a3ab-08f84477ac15 tempest-GroupsTest-700019740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:26 devstack sudo[88548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:43:26 devstack sudo[88548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:27 devstack sudo[88548]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-654ebb27-3d39-4248-a3ab-08f84477ac15 tempest-GroupsTest-700019740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.305s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:27 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-654ebb27-3d39-4248-a3ab-08f84477ac15 tempest-GroupsTest-700019740 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:43:27 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-654ebb27-3d39-4248-a3ab-08f84477ac15 tempest-GroupsTest-700019740 None] Delete group completed successfully. Sep 07 13:43:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-27c6aa60-37d4-495b-bbbe-70be9a047536 tempest-GroupsTest-700019740 None] Group tempest-GroupsTest-Group-1653129397: creating Sep 07 13:43:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-27c6aa60-37d4-495b-bbbe-70be9a047536 tempest-GroupsTest-700019740 None] Group tempest-GroupsTest-Group-1653129397: created successfully Sep 07 13:43:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-27c6aa60-37d4-495b-bbbe-70be9a047536 tempest-GroupsTest-700019740 None] Create group completed successfully. Sep 07 13:43:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:43:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:29 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:43:29 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:30 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.442s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 8 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Flow 'volume_create_manager' (4cae7292-356c-4691-b38d-07c74e9694d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93fad938-ca50-4f85-94d8-d9aaeb055e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93fad938-ca50-4f85-94d8-d9aaeb055e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1489447836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0bf5e282-9218-422b-8598-7e182352ca3a,host='devstack@QuobyteHD#QuobyteHD',id=4023609a-a569-4a2e-bf00-740ee2d30d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7123069894d80aeb3ce91acd118d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:31Z,use_quota=True,user_id='f15763efb91849aba9d89fca98aa2799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ae06031-3c67-49d2-ad41-d699a1d6208f),volume_type_id=0ae06031-3c67-49d2-ad41-d699a1d6208f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a7c33b-b348-4f1b-8f3d-a8d799cbe2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92a7c33b-b348-4f1b-8f3d-a8d799cbe2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac18e3c6-70f8-4092-84b3-33dbf51e712e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac18e3c6-70f8-4092-84b3-33dbf51e712e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4023609a-a569-4a2e-bf00-740ee2d30d03', 'volume_name': 'volume-4023609a-a569-4a2e-bf00-740ee2d30d03', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a3d29a-75c6-47fd-b056-28a86a631d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64a3d29a-75c6-47fd-b056-28a86a631d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c53dfd4-e74f-4652-8389-1171301172ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:30 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Volume 4023609a-a569-4a2e-bf00-740ee2d30d03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4023609a-a569-4a2e-bf00-740ee2d30d03', 'volume_size': 1} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0bf5e282-9218-422b-8598-7e182352ca3a,created_at=2026-09-07T11:43:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1489447836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0bf5e282-9218-422b-8598-7e182352ca3a,host='devstack@QuobyteHD#QuobyteHD',id=4023609a-a569-4a2e-bf00-740ee2d30d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7123069894d80aeb3ce91acd118d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:31Z,use_quota=True,user_id='f15763efb91849aba9d89fca98aa2799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ae06031-3c67-49d2-ad41-d699a1d6208f),volume_type_id=0ae06031-3c67-49d2-ad41-d699a1d6208f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Creating volume 4023609a-a569-4a2e-bf00-740ee2d30d03 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:43:30 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:43:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4023609a-a569-4a2e-bf00-740ee2d30d03 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:30 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4023609a-a569-4a2e-bf00-740ee2d30d03 1073741824 Sep 07 13:43:30 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:31 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4023609a-a569-4a2e-bf00-740ee2d30d03 1073741824" returned: 0 in 0.835s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4023609a-a569-4a2e-bf00-740ee2d30d03 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:31 devstack sudo[88627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4023609a-a569-4a2e-bf00-740ee2d30d03 Sep 07 13:43:31 devstack sudo[88627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:32 devstack sudo[88627]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4023609a-a569-4a2e-bf00-740ee2d30d03" returned: 0 in 0.407s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:43:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c53dfd4-e74f-4652-8389-1171301172ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4023609a-a569-4a2e-bf00-740ee2d30d03', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe07ace-36f1-4332-937e-f03c154469d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:32 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Volume volume-4023609a-a569-4a2e-bf00-740ee2d30d03 (4023609a-a569-4a2e-bf00-740ee2d30d03): created successfully Sep 07 13:43:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fe07ace-36f1-4332-937e-f03c154469d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Flow 'volume_create_manager' (4cae7292-356c-4691-b38d-07c74e9694d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:32 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f3da783a-286a-4de2-915c-216d4f6d8b41 tempest-GroupsTest-700019740 None] Created volume successfully. Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=62,cinder:INSERT=16,cinder:UPDATE=78,cinder:DELETE=5 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=62,cinder:UPDATE=76,cinder:DELETE=7,cinder:INSERT=18 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Flow 'volume_create_manager' (87cf17d9-e80c-42b8-a79e-0aa56b7b4f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc24e1d-d800-4dac-b83c-144c84671cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dc24e1d-d800-4dac-b83c-144c84671cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-6859288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0bf5e282-9218-422b-8598-7e182352ca3a,host='devstack@QuobyteHD#QuobyteHD',id=74203d3e-3322-418d-85dc-e9967c26ba37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7123069894d80aeb3ce91acd118d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:34Z,use_quota=True,user_id='f15763efb91849aba9d89fca98aa2799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ae06031-3c67-49d2-ad41-d699a1d6208f),volume_type_id=0ae06031-3c67-49d2-ad41-d699a1d6208f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5d4b27-0818-43fd-b75c-c34134da0253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc5d4b27-0818-43fd-b75c-c34134da0253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3bbfdb-77c5-4fe6-8dd2-008a14d7fda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed3bbfdb-77c5-4fe6-8dd2-008a14d7fda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74203d3e-3322-418d-85dc-e9967c26ba37', 'volume_name': 'volume-74203d3e-3322-418d-85dc-e9967c26ba37', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fd18db-e143-449c-9d54-8ea8ab01b272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46fd18db-e143-449c-9d54-8ea8ab01b272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96c70e1-4026-4bac-9100-0886e7609b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:34 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Volume 74203d3e-3322-418d-85dc-e9967c26ba37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74203d3e-3322-418d-85dc-e9967c26ba37', 'volume_size': 1} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0bf5e282-9218-422b-8598-7e182352ca3a,created_at=2026-09-07T11:43:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-6859288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0bf5e282-9218-422b-8598-7e182352ca3a,host='devstack@QuobyteHD#QuobyteHD',id=74203d3e-3322-418d-85dc-e9967c26ba37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0d7123069894d80aeb3ce91acd118d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:34Z,use_quota=True,user_id='f15763efb91849aba9d89fca98aa2799',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0ae06031-3c67-49d2-ad41-d699a1d6208f),volume_type_id=0ae06031-3c67-49d2-ad41-d699a1d6208f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Creating volume 74203d3e-3322-418d-85dc-e9967c26ba37 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:43:34 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:43:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-74203d3e-3322-418d-85dc-e9967c26ba37 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:34 devstack sudo[88678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-74203d3e-3322-418d-85dc-e9967c26ba37 1073741824 Sep 07 13:43:34 devstack sudo[88678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:35 devstack sudo[88678]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-74203d3e-3322-418d-85dc-e9967c26ba37 1073741824" returned: 0 in 0.786s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-74203d3e-3322-418d-85dc-e9967c26ba37 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:35 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-74203d3e-3322-418d-85dc-e9967c26ba37 Sep 07 13:43:35 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:35 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-74203d3e-3322-418d-85dc-e9967c26ba37" returned: 0 in 0.471s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] <== create_volume: return (1327ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:43:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.330s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96c70e1-4026-4bac-9100-0886e7609b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74203d3e-3322-418d-85dc-e9967c26ba37', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b88b5a4-3e5f-4bac-b43a-68ac890f27fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:35 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Volume volume-74203d3e-3322-418d-85dc-e9967c26ba37 (74203d3e-3322-418d-85dc-e9967c26ba37): created successfully Sep 07 13:43:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b88b5a4-3e5f-4bac-b43a-68ac890f27fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Flow 'volume_create_manager' (87cf17d9-e80c-42b8-a79e-0aa56b7b4f43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:35 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-72e97baf-e6e9-4bde-b94f-fc3020b22558 tempest-GroupsTest-700019740 None] Created volume successfully. Sep 07 13:43:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c8e4421e-7308-4cd5-9ca1-45b5dfb2b9a0 tempest-GroupsTest-700019740 None] Update group completed successfully. Sep 07 13:43:38 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6cf7b711-2d82-4cb5-8293-9dc4e3face59 tempest-GroupsTest-700019740 None] Update group completed successfully. Sep 07 13:43:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Acquiring lock "cinder-quobyte-4023609a-a569-4a2e-bf00-740ee2d30d03" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:43:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Lock "cinder-quobyte-4023609a-a569-4a2e-bf00-740ee2d30d03" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:43:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed8801b6-4ac6-415e-8719-fd0801372a0f]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:43:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4023609a-a569-4a2e-bf00-740ee2d30d03 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:40 devstack sudo[88770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4023609a-a569-4a2e-bf00-740ee2d30d03 Sep 07 13:43:40 devstack sudo[88770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:40 devstack sudo[88770]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4023609a-a569-4a2e-bf00-740ee2d30d03" returned: 0 in 0.441s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4023609a-a569-4a2e-bf00-740ee2d30d03 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:40 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4023609a-a569-4a2e-bf00-740ee2d30d03 Sep 07 13:43:40 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:41 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4023609a-a569-4a2e-bf00-740ee2d30d03" returned: 0 in 0.394s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Lock "cinder-quobyte-4023609a-a569-4a2e-bf00-740ee2d30d03" released by "delete_volume" :: held 0.898s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:43:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Acquiring lock "cinder-quobyte-74203d3e-3322-418d-85dc-e9967c26ba37" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:43:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Lock "cinder-quobyte-74203d3e-3322-418d-85dc-e9967c26ba37" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:43:41 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edeb12c-43ba-484a-a4e9-a71f144e311d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:43:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-74203d3e-3322-418d-85dc-e9967c26ba37 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:41 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-74203d3e-3322-418d-85dc-e9967c26ba37 Sep 07 13:43:41 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:41 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-74203d3e-3322-418d-85dc-e9967c26ba37" returned: 0 in 0.598s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-74203d3e-3322-418d-85dc-e9967c26ba37 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:42 devstack sudo[88802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-74203d3e-3322-418d-85dc-e9967c26ba37 Sep 07 13:43:42 devstack sudo[88802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:42 devstack sudo[88802]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-74203d3e-3322-418d-85dc-e9967c26ba37" returned: 0 in 0.346s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Lock "cinder-quobyte-74203d3e-3322-418d-85dc-e9967c26ba37" released by "delete_volume" :: held 1.025s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:43:42 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Created reservations ['466b30a7-d654-4a0c-b946-38c4a41b497f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:43:42 devstack cinder-volume[87444]: WARNING cinder.quota [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1899725988 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1899725988, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:43:42 devstack cinder-volume[87444]: WARNING cinder.quota [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1899725988 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1899725988, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:43:42 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Created reservations ['4ce6802b-1120-4981-ace8-8ca4492cd5fc', '085ea045-e206-451f-adf4-395400aa55d4', '4b27a02d-b474-40f8-88bf-88e33d378d23', 'f6dc78e8-0e96-4c52-b9ec-ea19e0082e43'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:43:42 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Created reservations ['93966ad7-22ef-457a-a6b4-cc9265ab1ed9', '7771454d-82d2-4a2a-ba3d-e475dbf81b28', '041b243f-6d38-44bf-94f9-a9947a5b54cf', '2dfcd17a-8889-4e45-a058-7fd07c412198'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:43:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:42 devstack sudo[88810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:43:42 devstack sudo[88810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:43 devstack sudo[88810]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.309s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:43 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:43:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3adc03e0-e32c-40c6-83ff-480b1ee72878 tempest-GroupsTest-700019740 None] Delete group completed successfully. Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Flow 'volume_create_manager' (6ecda360-9b2c-40ff-8333-2d7918685c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5333df90-77fc-4fb0-8775-e6c7aca8f9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5333df90-77fc-4fb0-8775-e6c7aca8f9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-616928956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60063472-16b0-4245-8be2-e97b340713be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab112efd0504b52a4de3f3f8361f768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:52Z,use_quota=True,user_id='1810e5bc07184721b54883fe691605c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697a5b5b-3a0c-4ae2-a76b-4e4b73c6d489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (697a5b5b-3a0c-4ae2-a76b-4e4b73c6d489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d77241a-ca7f-4d4f-9e82-a2300a513841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d77241a-ca7f-4d4f-9e82-a2300a513841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60063472-16b0-4245-8be2-e97b340713be', 'volume_name': 'volume-60063472-16b0-4245-8be2-e97b340713be', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f79ff1-a0f3-4f80-9259-7bb982db52e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f79ff1-a0f3-4f80-9259-7bb982db52e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a4a2fb-828b-448e-b5ad-d7568d24bb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:52 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Volume 60063472-16b0-4245-8be2-e97b340713be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60063472-16b0-4245-8be2-e97b340713be', 'volume_size': 1} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:43:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-616928956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60063472-16b0-4245-8be2-e97b340713be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ab112efd0504b52a4de3f3f8361f768',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:43:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:43:52Z,use_quota=True,user_id='1810e5bc07184721b54883fe691605c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Creating volume 60063472-16b0-4245-8be2-e97b340713be {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:43:52 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:43:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-60063472-16b0-4245-8be2-e97b340713be 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:52 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-60063472-16b0-4245-8be2-e97b340713be 1073741824 Sep 07 13:43:52 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:53 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-60063472-16b0-4245-8be2-e97b340713be 1073741824" returned: 0 in 0.971s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-60063472-16b0-4245-8be2-e97b340713be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:53 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-60063472-16b0-4245-8be2-e97b340713be Sep 07 13:43:53 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:54 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-60063472-16b0-4245-8be2-e97b340713be" returned: 0 in 0.801s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] <== create_volume: return (1986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:43:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99a4a2fb-828b-448e-b5ad-d7568d24bb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60063472-16b0-4245-8be2-e97b340713be', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a388ce8-4ead-47f3-8631-2623bedd0382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:43:54 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Volume volume-60063472-16b0-4245-8be2-e97b340713be (60063472-16b0-4245-8be2-e97b340713be): created successfully Sep 07 13:43:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a388ce8-4ead-47f3-8631-2623bedd0382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:43:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Flow 'volume_create_manager' (6ecda360-9b2c-40ff-8333-2d7918685c54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:43:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8d0999e5-4a1c-4284-87e3-022d75c5822c tempest-VolumesAdminNegativeTest-1080746378 None] Created volume successfully. Sep 07 13:43:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Acquiring lock "cinder-60063472-16b0-4245-8be2-e97b340713be-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:43:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Lock "cinder-60063472-16b0-4245-8be2-e97b340713be-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:43:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Acquiring lock "cinder-quobyte-60063472-16b0-4245-8be2-e97b340713be" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:43:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Lock "cinder-quobyte-60063472-16b0-4245-8be2-e97b340713be" acquired by "delete_volume" :: waited 0.038s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:43:57 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f4e998-7e2e-4a9d-9890-e183811ff2be]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:43:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-60063472-16b0-4245-8be2-e97b340713be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:57 devstack sudo[89038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-60063472-16b0-4245-8be2-e97b340713be Sep 07 13:43:57 devstack sudo[89038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:58 devstack sudo[89038]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-60063472-16b0-4245-8be2-e97b340713be" returned: 0 in 0.971s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-60063472-16b0-4245-8be2-e97b340713be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:58 devstack sudo[89055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-60063472-16b0-4245-8be2-e97b340713be Sep 07 13:43:58 devstack sudo[89055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:59 devstack sudo[89055]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-60063472-16b0-4245-8be2-e97b340713be" returned: 0 in 0.503s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Lock "cinder-quobyte-60063472-16b0-4245-8be2-e97b340713be" released by "delete_volume" :: held 1.618s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:43:59 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Created reservations ['46882715-8c10-4707-839c-463232404b56', '5dddcd29-c97a-46dc-81eb-615bf8006aae', 'bb44742f-0e9e-4e07-bf55-6ac26accb3d6', '47a98185-e814-436d-8629-064382bdae66'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:43:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:43:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:43:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:43:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:43:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:43:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:43:59 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:43:59 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:43:59 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Sep 07 13:43:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.543s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:43:59 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:43:59 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Deleted volume successfully. Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ade26d73-e1e3-4983-a340-4e58814619e3 tempest-VolumesAdminNegativeTest-1080746378 None] Lock "cinder-60063472-16b0-4245-8be2-e97b340713be-delete_volume" released by "delete_volume" :: held 2.758s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Flow 'volume_create_manager' (9cf2f9ff-18b2-4d8e-875b-e7a8a63d3981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf85c84-0a4e-4c6f-a0b1-e4cc029165fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbf85c84-0a4e-4c6f-a0b1-e4cc029165fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1599501278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c867a0-fb86-4b1b-855d-d16695bfdaa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb43448204b84f8180e1a907fe01dee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:44:00Z,use_quota=True,user_id='a665fa53ad324dec966180a36f7f876a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb881a81-30f7-4459-92f1-db538f3403a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb881a81-30f7-4459-92f1-db538f3403a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87c26e5-8ca7-4de0-b645-e38bf330abde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87c26e5-8ca7-4de0-b645-e38bf330abde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68c867a0-fb86-4b1b-855d-d16695bfdaa9', 'volume_name': 'volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53423112-071d-4da8-9681-24f0e8d8f6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53423112-071d-4da8-9681-24f0e8d8f6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13226f85-1e4b-4a43-8f02-248f5ca06f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:00 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Volume 68c867a0-fb86-4b1b-855d-d16695bfdaa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9', 'volume_size': 1} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1599501278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68c867a0-fb86-4b1b-855d-d16695bfdaa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb43448204b84f8180e1a907fe01dee3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:44:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:44:00Z,use_quota=True,user_id='a665fa53ad324dec966180a36f7f876a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Creating volume 68c867a0-fb86-4b1b-855d-d16695bfdaa9 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:44:00 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:44:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:00 devstack sudo[89064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 1073741824 Sep 07 13:44:00 devstack sudo[89064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:01 devstack sudo[89064]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 1073741824" returned: 0 in 0.979s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:01 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 Sep 07 13:44:01 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:01 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9" returned: 0 in 0.378s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:44:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.459s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13226f85-1e4b-4a43-8f02-248f5ca06f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c2ff75-7d5e-4836-9a0f-cef1d425bb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:01 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Volume volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 (68c867a0-fb86-4b1b-855d-d16695bfdaa9): created successfully Sep 07 13:44:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20c2ff75-7d5e-4836-9a0f-cef1d425bb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Flow 'volume_create_manager' (9cf2f9ff-18b2-4d8e-875b-e7a8a63d3981) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:44:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3b66ee53-b3aa-4c39-910e-b70deca53252 tempest-SnapshotsActionsTest-1209793435 None] Created volume successfully. Sep 07 13:44:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] Creating offline snapshot 4dea316e-46ed-499a-9d72-3b196221f73d of volume 68c867a0-fb86-4b1b-855d-d16695bfdaa9 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:44:02 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1962b6-6f30-4f6d-8eff-2ce699e96aff]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:03 devstack sudo[89099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 Sep 07 13:44:03 devstack sudo[89099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:03 devstack sudo[89099]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9" returned: 0 in 0.665s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:03 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d 1G Sep 07 13:44:03 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:04 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d 1G" returned: 0 in 0.580s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:04 devstack sudo[89112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d Sep 07 13:44:04 devstack sudo[89112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:04 devstack sudo[89112]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d" returned: 0 in 0.409s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:04 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d is being set with open permissions: ugo+rw Sep 07 13:44:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:04 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d Sep 07 13:44:04 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:04 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d" returned: 0 in 0.408s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:05 devstack sudo[89122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.info Sep 07 13:44:05 devstack sudo[89122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:05 devstack sudo[89122]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.info" returned: 0 in 0.435s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:05 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.info is being set with open permissions: ugo+rw Sep 07 13:44:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:05 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.info Sep 07 13:44:05 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:05 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.info" returned: 0 in 0.436s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.097s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:05 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d224aef6-77e6-4604-94e3-5e052d286dde tempest-SnapshotsActionsTest-1209793435 None] Create snapshot completed successfully Sep 07 13:44:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f1620502-61d0-4dc8-8587-18ab3635fafe tempest-SnapshotsActionsTest-1209793435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f1620502-61d0-4dc8-8587-18ab3635fafe tempest-SnapshotsActionsTest-1209793435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f1620502-61d0-4dc8-8587-18ab3635fafe tempest-SnapshotsActionsTest-1209793435 None] Creating offline snapshot d27cd1c4-79aa-446a-9b76-672728fb07b8 of volume 68c867a0-fb86-4b1b-855d-d16695bfdaa9 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:44:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b8afbb-b779-48c7-afb8-168a1bba8748]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1620502-61d0-4dc8-8587-18ab3635fafe tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:07 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d Sep 07 13:44:07 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:08 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1620502-61d0-4dc8-8587-18ab3635fafe tempest-SnapshotsActionsTest-1209793435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d" returned: 0 in 0.399s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f1620502-61d0-4dc8-8587-18ab3635fafe tempest-SnapshotsActionsTest-1209793435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:44:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1620502-61d0-4dc8-8587-18ab3635fafe tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:08 devstack sudo[89158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8 1G Sep 07 13:44:08 devstack sudo[89158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:08 devstack sudo[89158]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1620502-61d0-4dc8-8587-18ab3635fafe tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8 1G" returned: 0 in 0.480s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1620502-61d0-4dc8-8587-18ab3635fafe tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:08 devstack sudo[89164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8 Sep 07 13:44:08 devstack sudo[89164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:09 devstack sudo[89164]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1620502-61d0-4dc8-8587-18ab3635fafe tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8" returned: 0 in 0.400s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:09 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-f1620502-61d0-4dc8-8587-18ab3635fafe tempest-SnapshotsActionsTest-1209793435 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8 is being set with open permissions: ugo+rw Sep 07 13:44:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1620502-61d0-4dc8-8587-18ab3635fafe tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:09 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8 Sep 07 13:44:09 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:09 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1620502-61d0-4dc8-8587-18ab3635fafe tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8" returned: 0 in 0.291s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f1620502-61d0-4dc8-8587-18ab3635fafe tempest-SnapshotsActionsTest-1209793435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.694s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f1620502-61d0-4dc8-8587-18ab3635fafe tempest-SnapshotsActionsTest-1209793435 None] Create snapshot completed successfully Sep 07 13:44:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Acquiring lock "cinder-d27cd1c4-79aa-446a-9b76-672728fb07b8-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-d27cd1c4-79aa-446a-9b76-672728fb07b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Acquiring lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Acquiring lock "cinder-quobyte-d27cd1c4-79aa-446a-9b76-672728fb07b8" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-quobyte-d27cd1c4-79aa-446a-9b76-672728fb07b8" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Deleting offline snapshot d27cd1c4-79aa-446a-9b76-672728fb07b8 of volume 68c867a0-fb86-4b1b-855d-d16695bfdaa9 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:44:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] snapshot_file for this snap is: volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:44:10 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[018b61f4-eb7f-40f0-b60f-2943d08dedd8]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:10 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8 Sep 07 13:44:10 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:10 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8" returned: 0 in 0.405s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:44:10 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15fc9df-f0fa-4f93-a749-c186c447348d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:10 devstack sudo[89178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d Sep 07 13:44:10 devstack sudo[89178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:11 devstack sudo[89178]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d" returned: 0 in 0.427s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:44:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:11 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8 Sep 07 13:44:11 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:11 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8" returned: 0 in 0.456s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:11 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8 Sep 07 13:44:11 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:11 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.d27cd1c4-79aa-446a-9b76-672728fb07b8" returned: 0 in 0.281s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-quobyte-d27cd1c4-79aa-446a-9b76-672728fb07b8" released by "_delete_snapshot" :: held 1.707s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" released by "delete_snapshot" :: held 1.739s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:11 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Created reservations ['e5974163-07c8-4105-87a1-6909df74069a', 'bc377466-9546-42e6-a8f4-b7448efe80b1', 'b5b4d017-583f-4d85-9d66-fbc7a6677df9', '408cf452-619f-4c97-9ade-9a39ab53c8b3'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:44:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Delete snapshot completed successfully. Sep 07 13:44:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8e653982-0f10-4c61-81a8-7adbfa847837 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-d27cd1c4-79aa-446a-9b76-672728fb07b8-delete_snapshot" released by "delete_snapshot" :: held 1.984s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c15aa883-20b7-4081-a77b-8a2a531b2479 tempest-SnapshotsActionsTest-1209793435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c15aa883-20b7-4081-a77b-8a2a531b2479 tempest-SnapshotsActionsTest-1209793435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c15aa883-20b7-4081-a77b-8a2a531b2479 tempest-SnapshotsActionsTest-1209793435 None] Creating offline snapshot cecc44b3-7845-4028-b9aa-ac01329b67ae of volume 68c867a0-fb86-4b1b-855d-d16695bfdaa9 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:44:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0adc5759-be6d-43a1-aa79-f970d23dc73f]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c15aa883-20b7-4081-a77b-8a2a531b2479 tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:12 devstack sudo[89194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d Sep 07 13:44:12 devstack sudo[89194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:13 devstack sudo[89194]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c15aa883-20b7-4081-a77b-8a2a531b2479 tempest-SnapshotsActionsTest-1209793435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d" returned: 0 in 0.448s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c15aa883-20b7-4081-a77b-8a2a531b2479 tempest-SnapshotsActionsTest-1209793435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:44:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c15aa883-20b7-4081-a77b-8a2a531b2479 tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:13 devstack sudo[89200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae 1G Sep 07 13:44:13 devstack sudo[89200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:14 devstack sudo[89200]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c15aa883-20b7-4081-a77b-8a2a531b2479 tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae 1G" returned: 0 in 0.822s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c15aa883-20b7-4081-a77b-8a2a531b2479 tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:14 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae Sep 07 13:44:14 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:14 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c15aa883-20b7-4081-a77b-8a2a531b2479 tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae" returned: 0 in 0.332s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:14 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-c15aa883-20b7-4081-a77b-8a2a531b2479 tempest-SnapshotsActionsTest-1209793435 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae is being set with open permissions: ugo+rw Sep 07 13:44:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c15aa883-20b7-4081-a77b-8a2a531b2479 tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:14 devstack sudo[89212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae Sep 07 13:44:14 devstack sudo[89212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:14 devstack sudo[89212]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c15aa883-20b7-4081-a77b-8a2a531b2479 tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae" returned: 0 in 0.288s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c15aa883-20b7-4081-a77b-8a2a531b2479 tempest-SnapshotsActionsTest-1209793435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c15aa883-20b7-4081-a77b-8a2a531b2479 tempest-SnapshotsActionsTest-1209793435 None] Create snapshot completed successfully Sep 07 13:44:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Acquiring lock "cinder-cecc44b3-7845-4028-b9aa-ac01329b67ae-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-cecc44b3-7845-4028-b9aa-ac01329b67ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Acquiring lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Acquiring lock "cinder-quobyte-cecc44b3-7845-4028-b9aa-ac01329b67ae" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-quobyte-cecc44b3-7845-4028-b9aa-ac01329b67ae" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Deleting offline snapshot cecc44b3-7845-4028-b9aa-ac01329b67ae of volume 68c867a0-fb86-4b1b-855d-d16695bfdaa9 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:44:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] snapshot_file for this snap is: volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:44:15 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6878e16-8cb6-42dc-be36-d266ae442b71]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:15 devstack sudo[89215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae Sep 07 13:44:15 devstack sudo[89215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:15 devstack sudo[89215]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae" returned: 0 in 0.592s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:44:15 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bed664b-6196-4d4b-a461-826a5ca2da21]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:16 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d Sep 07 13:44:16 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:16 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d" returned: 0 in 0.497s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:44:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:16 devstack sudo[89229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae Sep 07 13:44:16 devstack sudo[89229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:17 devstack sudo[89229]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae" returned: 0 in 0.577s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:17 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae Sep 07 13:44:17 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:17 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.cecc44b3-7845-4028-b9aa-ac01329b67ae" returned: 0 in 0.376s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-quobyte-cecc44b3-7845-4028-b9aa-ac01329b67ae" released by "_delete_snapshot" :: held 2.205s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" released by "delete_snapshot" :: held 2.247s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:17 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Created reservations ['ba72f8da-1fb1-4a2b-8b4e-1ffc6c90d55c', 'c1c2849a-a0d5-4394-bb4f-281049d26e98', 'b2bf83b4-9e5c-4d18-a7ee-f90a76709776', '9c2b0f32-f2ae-4ff2-b9ad-4e2ec2331d51'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:44:17 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Delete snapshot completed successfully. Sep 07 13:44:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9eee1155-2675-4b5e-86c5-5f6304302a91 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-cecc44b3-7845-4028-b9aa-ac01329b67ae-delete_snapshot" released by "delete_snapshot" :: held 2.462s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7dc10c8-b4be-4f93-bf9f-ad600d77da6e tempest-SnapshotsActionsTest-1209793435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7dc10c8-b4be-4f93-bf9f-ad600d77da6e tempest-SnapshotsActionsTest-1209793435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e7dc10c8-b4be-4f93-bf9f-ad600d77da6e tempest-SnapshotsActionsTest-1209793435 None] Creating offline snapshot 214c9439-4234-40d6-af6c-348baf80c476 of volume 68c867a0-fb86-4b1b-855d-d16695bfdaa9 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:44:18 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8581476-ac4a-466b-871e-98ff2f2446a0]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7dc10c8-b4be-4f93-bf9f-ad600d77da6e tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:19 devstack sudo[89240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d Sep 07 13:44:19 devstack sudo[89240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:19 devstack sudo[89240]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7dc10c8-b4be-4f93-bf9f-ad600d77da6e tempest-SnapshotsActionsTest-1209793435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d" returned: 0 in 0.510s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e7dc10c8-b4be-4f93-bf9f-ad600d77da6e tempest-SnapshotsActionsTest-1209793435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:44:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7dc10c8-b4be-4f93-bf9f-ad600d77da6e tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:19 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476 1G Sep 07 13:44:19 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:20 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7dc10c8-b4be-4f93-bf9f-ad600d77da6e tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476 1G" returned: 0 in 0.646s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7dc10c8-b4be-4f93-bf9f-ad600d77da6e tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:20 devstack sudo[89256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476 Sep 07 13:44:20 devstack sudo[89256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:20 devstack sudo[89256]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7dc10c8-b4be-4f93-bf9f-ad600d77da6e tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476" returned: 0 in 0.378s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:20 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-e7dc10c8-b4be-4f93-bf9f-ad600d77da6e tempest-SnapshotsActionsTest-1209793435 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476 is being set with open permissions: ugo+rw Sep 07 13:44:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7dc10c8-b4be-4f93-bf9f-ad600d77da6e tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:20 devstack sudo[89261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476 Sep 07 13:44:20 devstack sudo[89261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:20 devstack sudo[89261]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7dc10c8-b4be-4f93-bf9f-ad600d77da6e tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476" returned: 0 in 0.261s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7dc10c8-b4be-4f93-bf9f-ad600d77da6e tempest-SnapshotsActionsTest-1209793435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.916s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e7dc10c8-b4be-4f93-bf9f-ad600d77da6e tempest-SnapshotsActionsTest-1209793435 None] Create snapshot completed successfully Sep 07 13:44:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Acquiring lock "cinder-214c9439-4234-40d6-af6c-348baf80c476-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-214c9439-4234-40d6-af6c-348baf80c476-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Acquiring lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Acquiring lock "cinder-quobyte-214c9439-4234-40d6-af6c-348baf80c476" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-quobyte-214c9439-4234-40d6-af6c-348baf80c476" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Deleting offline snapshot 214c9439-4234-40d6-af6c-348baf80c476 of volume 68c867a0-fb86-4b1b-855d-d16695bfdaa9 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:44:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] snapshot_file for this snap is: volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:44:21 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef52282-f64d-41a3-805d-ea3bb4e797fc]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:21 devstack sudo[89264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476 Sep 07 13:44:21 devstack sudo[89264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:21 devstack sudo[89264]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476" returned: 0 in 0.426s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:44:21 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d4ea87-e256-4189-9c31-76e0962faa2b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:21 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d Sep 07 13:44:21 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:22 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d" returned: 0 in 0.430s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:44:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:22 devstack sudo[89280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476 Sep 07 13:44:22 devstack sudo[89280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:22 devstack sudo[89280]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476" returned: 0 in 0.444s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:22 devstack sudo[89287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476 Sep 07 13:44:22 devstack sudo[89287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:22 devstack sudo[89287]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.214c9439-4234-40d6-af6c-348baf80c476" returned: 0 in 0.253s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-quobyte-214c9439-4234-40d6-af6c-348baf80c476" released by "_delete_snapshot" :: held 1.712s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" released by "delete_snapshot" :: held 1.741s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:23 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Created reservations ['4b017361-a125-47fc-96ab-dad46125b7a1', '43123c85-e5a8-41f7-bcbc-9109018095ee', '5c0d7f8c-4214-4af9-81c0-47e2f4c27ba9', '3876eff7-b5cf-408f-91c2-db0bbc2fa713'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:44:23 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Delete snapshot completed successfully. Sep 07 13:44:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1083c227-0857-4b9d-9f3a-7d536e67afc8 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-214c9439-4234-40d6-af6c-348baf80c476-delete_snapshot" released by "delete_snapshot" :: held 1.902s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5b16fce7-3a58-42e9-86b3-90229abfeb60 tempest-SnapshotsActionsTest-1209793435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5b16fce7-3a58-42e9-86b3-90229abfeb60 tempest-SnapshotsActionsTest-1209793435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5b16fce7-3a58-42e9-86b3-90229abfeb60 tempest-SnapshotsActionsTest-1209793435 None] Creating offline snapshot e40d45d1-5ec3-4431-a6d7-fc23dc9c682c of volume 68c867a0-fb86-4b1b-855d-d16695bfdaa9 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:44:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b811ccc-1c26-4bc7-b2b6-da57b5474ddf]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b16fce7-3a58-42e9-86b3-90229abfeb60 tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:23 devstack sudo[89290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d Sep 07 13:44:23 devstack sudo[89290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:24 devstack sudo[89290]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b16fce7-3a58-42e9-86b3-90229abfeb60 tempest-SnapshotsActionsTest-1209793435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d" returned: 0 in 0.427s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5b16fce7-3a58-42e9-86b3-90229abfeb60 tempest-SnapshotsActionsTest-1209793435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:44:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b16fce7-3a58-42e9-86b3-90229abfeb60 tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:24 devstack sudo[89295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c 1G Sep 07 13:44:24 devstack sudo[89295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:24 devstack sudo[89295]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b16fce7-3a58-42e9-86b3-90229abfeb60 tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c 1G" returned: 0 in 0.502s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b16fce7-3a58-42e9-86b3-90229abfeb60 tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:24 devstack sudo[89301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c Sep 07 13:44:24 devstack sudo[89301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:25 devstack sudo[89301]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b16fce7-3a58-42e9-86b3-90229abfeb60 tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c" returned: 0 in 0.454s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:25 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-5b16fce7-3a58-42e9-86b3-90229abfeb60 tempest-SnapshotsActionsTest-1209793435 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c is being set with open permissions: ugo+rw Sep 07 13:44:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b16fce7-3a58-42e9-86b3-90229abfeb60 tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:25 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c Sep 07 13:44:25 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:25 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b16fce7-3a58-42e9-86b3-90229abfeb60 tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c" returned: 0 in 0.289s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5b16fce7-3a58-42e9-86b3-90229abfeb60 tempest-SnapshotsActionsTest-1209793435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.805s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5b16fce7-3a58-42e9-86b3-90229abfeb60 tempest-SnapshotsActionsTest-1209793435 None] Create snapshot completed successfully Sep 07 13:44:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Acquiring lock "cinder-e40d45d1-5ec3-4431-a6d7-fc23dc9c682c-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-e40d45d1-5ec3-4431-a6d7-fc23dc9c682c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Acquiring lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Acquiring lock "cinder-quobyte-e40d45d1-5ec3-4431-a6d7-fc23dc9c682c" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-quobyte-e40d45d1-5ec3-4431-a6d7-fc23dc9c682c" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Deleting offline snapshot e40d45d1-5ec3-4431-a6d7-fc23dc9c682c of volume 68c867a0-fb86-4b1b-855d-d16695bfdaa9 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:44:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] snapshot_file for this snap is: volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:44:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24851d0-636c-4e7f-a94e-a6f7b5c23f26]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:26 devstack sudo[89350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c Sep 07 13:44:26 devstack sudo[89350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:27 devstack sudo[89350]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c" returned: 0 in 0.816s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:44:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6646bc-fe77-4990-aff1-40f73aff2c2f]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:27 devstack sudo[89373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d Sep 07 13:44:27 devstack sudo[89373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:27 devstack sudo[89373]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d" returned: 0 in 0.697s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:44:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:27 devstack sudo[89386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c Sep 07 13:44:27 devstack sudo[89386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:28 devstack sudo[89386]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c" returned: 0 in 0.558s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:28 devstack sudo[89397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c Sep 07 13:44:28 devstack sudo[89397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:28 devstack sudo[89397]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.e40d45d1-5ec3-4431-a6d7-fc23dc9c682c" returned: 0 in 0.386s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-quobyte-e40d45d1-5ec3-4431-a6d7-fc23dc9c682c" released by "_delete_snapshot" :: held 2.638s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" released by "delete_snapshot" :: held 2.683s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:29 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Created reservations ['bfa7d128-457b-48c9-a4bd-ac1d564ea521', '6a0d2c37-5a49-4b76-88ba-1856a6c5dde0', '3fb127f8-24b7-4715-8475-c69b3aa2fd2d', '2795d502-d073-453b-8500-c1673dc06a46'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:44:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Delete snapshot completed successfully. Sep 07 13:44:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-efc582d7-624c-462c-9155-2bb7f34a9316 tempest-SnapshotsActionsTest-594529195 None] Lock "cinder-e40d45d1-5ec3-4431-a6d7-fc23dc9c682c-delete_snapshot" released by "delete_snapshot" :: held 2.863s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:44:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:44:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:44:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:29 devstack sudo[89419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:44:29 devstack sudo[89419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:30 devstack sudo[89419]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.398s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:44:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Acquiring lock "cinder-4dea316e-46ed-499a-9d72-3b196221f73d-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Lock "cinder-4dea316e-46ed-499a-9d72-3b196221f73d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Acquiring lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Acquiring lock "cinder-quobyte-4dea316e-46ed-499a-9d72-3b196221f73d" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Lock "cinder-quobyte-4dea316e-46ed-499a-9d72-3b196221f73d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Deleting offline snapshot 4dea316e-46ed-499a-9d72-3b196221f73d of volume 68c867a0-fb86-4b1b-855d-d16695bfdaa9 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:44:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] snapshot_file for this snap is: volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:44:30 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[79cf8b09-a8b9-4578-b5d8-e743ac0b903a]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:30 devstack sudo[89423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d Sep 07 13:44:30 devstack sudo[89423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:30 devstack sudo[89423]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d" returned: 0 in 0.513s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:44:31 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfbc83b-1bbb-4a88-a6c5-cc6b3412324c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:31 devstack sudo[89437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 Sep 07 13:44:31 devstack sudo[89437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:31 devstack cinder-volume[87444]: WARNING py.warnings [req-7d54647b-a040-434e-a7fa-5697b0e486d2 req-e720cb2d-3d05-4693-87f9-3133755cc1ba tempest-TaggedAttachmentsTest-413219049 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Sep 07 13:44:31 devstack cinder-volume[87444]: .first() Sep 07 13:44:31 devstack cinder-volume[87444]: Sep 07 13:44:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-7d54647b-a040-434e-a7fa-5697b0e486d2 req-e720cb2d-3d05-4693-87f9-3133755cc1ba tempest-TaggedAttachmentsTest-413219049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-7d54647b-a040-434e-a7fa-5697b0e486d2 req-e720cb2d-3d05-4693-87f9-3133755cc1ba tempest-TaggedAttachmentsTest-413219049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-7d54647b-a040-434e-a7fa-5697b0e486d2 req-e720cb2d-3d05-4693-87f9-3133755cc1ba tempest-TaggedAttachmentsTest-413219049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-7d54647b-a040-434e-a7fa-5697b0e486d2 req-e720cb2d-3d05-4693-87f9-3133755cc1ba tempest-TaggedAttachmentsTest-413219049 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dc88f2ca-4fbf-43dc-b6c6-c7a38f82079e', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:44:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-7d54647b-a040-434e-a7fa-5697b0e486d2 req-e720cb2d-3d05-4693-87f9-3133755cc1ba tempest-TaggedAttachmentsTest-413219049 None] attachment_update completed successfully. Sep 07 13:44:31 devstack sudo[89437]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9" returned: 0 in 0.495s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:31 devstack sudo[89447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d Sep 07 13:44:31 devstack sudo[89447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:32 devstack sudo[89447]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d" returned: 0 in 0.510s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:32 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d Sep 07 13:44:32 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:32 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9.4dea316e-46ed-499a-9d72-3b196221f73d" returned: 0 in 0.726s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Lock "cinder-quobyte-4dea316e-46ed-499a-9d72-3b196221f73d" released by "_delete_snapshot" :: held 2.467s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" released by "delete_snapshot" :: held 2.504s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:33 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Created reservations ['46beb34e-1dba-429c-a04c-ca68fecca7fb', '804d1d29-ff07-4bff-8b9e-61ff9be3411e', '98ad48c3-30d8-4bc8-801e-15e0ff9d93ab', 'a815e624-0667-46c6-9c96-791ca273cc7d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:44:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Delete snapshot completed successfully. Sep 07 13:44:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9f3e390d-bd6e-4cc8-89ba-7de2f360c98f tempest-SnapshotsActionsTest-1209793435 None] Lock "cinder-4dea316e-46ed-499a-9d72-3b196221f73d-delete_snapshot" released by "delete_snapshot" :: held 2.876s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Acquiring lock "cinder-68c867a0-fb86-4b1b-855d-d16695bfdaa9-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Lock "cinder-68c867a0-fb86-4b1b-855d-d16695bfdaa9-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Acquiring lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" acquired by "delete_volume" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:33 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c02678-f67e-4144-926f-c39380550414]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:34 devstack sudo[89946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 Sep 07 13:44:34 devstack sudo[89946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:34 devstack sudo[89946]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9" returned: 0 in 0.614s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:34 devstack sudo[89955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9 Sep 07 13:44:34 devstack sudo[89955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:34 devstack sudo[89955]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-68c867a0-fb86-4b1b-855d-d16695bfdaa9" returned: 0 in 0.398s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Lock "cinder-quobyte-68c867a0-fb86-4b1b-855d-d16695bfdaa9" released by "delete_volume" :: held 1.147s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:34 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=71,cinder:INSERT=16,cinder:UPDATE=73,cinder:DELETE=4 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:44:34 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=75,cinder:UPDATE=71,cinder:DELETE=5,cinder:INSERT=21 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:44:35 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Created reservations ['0ed4716f-d9e4-4649-bc57-363dcbc9e462', 'ae6e20bb-a3a3-4439-b5db-90fc1155a134', 'd693590d-b3cf-4e14-8471-85a9d1085ba9', '1c844765-f16c-4673-82f1-df0fda36c92d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:44:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:44:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:44:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:35 devstack sudo[89958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:44:35 devstack sudo[89958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:35 devstack sudo[89958]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.348s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:35 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:44:35 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Deleted volume successfully. Sep 07 13:44:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7dd7577d-152c-4b19-ac63-cdfe4311c0e7 tempest-SnapshotsActionsTest-1209793435 None] Lock "cinder-68c867a0-fb86-4b1b-855d-d16695bfdaa9-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:36 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-3c9d966f-b654-4664-9361-392146c179dd req-09e9c3f3-7284-4f89-b2eb-4564f2619dce tempest-TaggedAttachmentsTest-413219049 None] Terminate volume connection completed successfully. Sep 07 13:44:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-3c9d966f-b654-4664-9361-392146c179dd req-09e9c3f3-7284-4f89-b2eb-4564f2619dce tempest-TaggedAttachmentsTest-413219049 None] Deleting attachment dc88f2ca-4fbf-43dc-b6c6-c7a38f82079e. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:44:45 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=5,cinder:SELECT=2,cinder:DELETE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:44:46 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=6,cinder:INSERT=4,cinder:UPDATE=10 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:44:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Acquiring lock "cinder-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Lock "cinder-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Acquiring lock "cinder-quobyte-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Lock "cinder-quobyte-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e" acquired by "delete_volume" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:55 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[db26b944-bda9-429d-b18b-d87b41fa6e1b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:55 devstack sudo[90110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e Sep 07 13:44:55 devstack sudo[90110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:55 devstack sudo[90110]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e" returned: 0 in 0.546s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:56 devstack sudo[90115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e Sep 07 13:44:56 devstack sudo[90115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:56 devstack sudo[90115]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e" returned: 0 in 0.346s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Lock "cinder-quobyte-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e" released by "delete_volume" :: held 0.968s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Created reservations ['fb82fa76-a5d9-478d-9fd5-0c0481897c2f', 'b6941454-3670-4e1e-9e2b-aea459df38c7', '2ecfdf85-b15f-463f-a3af-3d8af8c586b6', '1e522a44-10eb-4a71-b1ae-c93dabeef33b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:56 devstack sudo[90126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:44:56 devstack sudo[90126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Flow 'volume_create_manager' (c3735c8f-fcb3-4108-83f0-a2144d99625f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c796fc6-52fa-490b-83de-a073feb1c810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c796fc6-52fa-490b-83de-a073feb1c810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1703307644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22b44e6e-b8a4-4877-84e8-ba73fdb424a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ffad8abafe04a32965dc097dfffaea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:44:57Z,use_quota=True,user_id='a45a2ef454124cdda728d54a26656a27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ea40a6-2e88-4f7f-b1c1-e72ea84b5784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ea40a6-2e88-4f7f-b1c1-e72ea84b5784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b07d0de-eabf-497c-8490-238cedb749e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3b07d0de-eabf-497c-8490-238cedb749e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22b44e6e-b8a4-4877-84e8-ba73fdb424a7', 'volume_name': 'volume-22b44e6e-b8a4-4877-84e8-ba73fdb424a7', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d877c0b-ed61-4a04-831e-af6642fc27de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d877c0b-ed61-4a04-831e-af6642fc27de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f14a1c-cf36-499f-95cf-d679510db205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:56 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Volume 22b44e6e-b8a4-4877-84e8-ba73fdb424a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22b44e6e-b8a4-4877-84e8-ba73fdb424a7', 'volume_size': 1} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1703307644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22b44e6e-b8a4-4877-84e8-ba73fdb424a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ffad8abafe04a32965dc097dfffaea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:44:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:44:57Z,use_quota=True,user_id='a45a2ef454124cdda728d54a26656a27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Creating volume 22b44e6e-b8a4-4877-84e8-ba73fdb424a7 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:44:56 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22b44e6e-b8a4-4877-84e8-ba73fdb424a7 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:56 devstack sudo[90129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22b44e6e-b8a4-4877-84e8-ba73fdb424a7 1073741824 Sep 07 13:44:56 devstack sudo[90126]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:56 devstack sudo[90129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.299s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:44:56 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Deleted volume successfully. Sep 07 13:44:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-901fef43-cf95-491e-b169-296ca8303a93 tempest-TaggedAttachmentsTest-413219049 None] Lock "cinder-1bc0ed93-bcfd-4b50-adc2-ca0677257a3e-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:44:57 devstack sudo[90129]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22b44e6e-b8a4-4877-84e8-ba73fdb424a7 1073741824" returned: 0 in 0.827s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22b44e6e-b8a4-4877-84e8-ba73fdb424a7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:57 devstack sudo[90182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22b44e6e-b8a4-4877-84e8-ba73fdb424a7 Sep 07 13:44:57 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:44:58 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root Sep 07 13:44:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22b44e6e-b8a4-4877-84e8-ba73fdb424a7" returned: 0 in 0.452s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:44:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] <== create_volume: return (1380ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:44:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.383s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:44:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23f14a1c-cf36-499f-95cf-d679510db205) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22b44e6e-b8a4-4877-84e8-ba73fdb424a7', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01267b7-0f40-4f6c-a41c-e08649c9095c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:44:58 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Volume volume-22b44e6e-b8a4-4877-84e8-ba73fdb424a7 (22b44e6e-b8a4-4877-84e8-ba73fdb424a7): created successfully Sep 07 13:44:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e01267b7-0f40-4f6c-a41c-e08649c9095c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:44:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Flow 'volume_create_manager' (c3735c8f-fcb3-4108-83f0-a2144d99625f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:44:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fbbc0af9-4d96-46f6-b492-340b3144fc6a tempest-VolumeQuotasAdminTestJSON-217352631 None] Created volume successfully. Sep 07 13:44:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Acquiring lock "cinder-22b44e6e-b8a4-4877-84e8-ba73fdb424a7-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Lock "cinder-22b44e6e-b8a4-4877-84e8-ba73fdb424a7-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Acquiring lock "cinder-quobyte-22b44e6e-b8a4-4877-84e8-ba73fdb424a7" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:44:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Lock "cinder-quobyte-22b44e6e-b8a4-4877-84e8-ba73fdb424a7" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:44:59 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d50a32e-cd29-436c-8d22-ccfb4027b25e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:44:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22b44e6e-b8a4-4877-84e8-ba73fdb424a7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:44:59 devstack sudo[90210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22b44e6e-b8a4-4877-84e8-ba73fdb424a7 Sep 07 13:44:59 devstack sudo[90210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:00 devstack sudo[90210]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22b44e6e-b8a4-4877-84e8-ba73fdb424a7" returned: 0 in 0.634s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22b44e6e-b8a4-4877-84e8-ba73fdb424a7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:00 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22b44e6e-b8a4-4877-84e8-ba73fdb424a7 Sep 07 13:45:00 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Flow 'volume_create_manager' (5bdec124-bbcf-4374-93a6-10db5b0fe830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999e1576-c793-4e9c-8918-38d9b48c5e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (999e1576-c793-4e9c-8918-38d9b48c5e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-117263095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1915e1-4dfd-4547-a1cb-17e1fa136b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c423bd8652c4a07a37f5c7c1ae948cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:00Z,use_quota=True,user_id='773502c44bb8400890c2a3fc6b51734e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bd4e89-38f1-4703-825b-d8a4c1b431b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bd4e89-38f1-4703-825b-d8a4c1b431b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6448ebb0-982e-476f-9714-73e22c55ef65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6448ebb0-982e-476f-9714-73e22c55ef65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a1915e1-4dfd-4547-a1cb-17e1fa136b20', 'volume_name': 'volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0403f2-43a6-498d-8262-230c7be0f6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0403f2-43a6-498d-8262-230c7be0f6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67aa2a78-68a6-43ce-866e-fb4c88d8ba60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:00 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Volume 8a1915e1-4dfd-4547-a1cb-17e1fa136b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20', 'volume_size': 1} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-117263095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1915e1-4dfd-4547-a1cb-17e1fa136b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c423bd8652c4a07a37f5c7c1ae948cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:00Z,use_quota=True,user_id='773502c44bb8400890c2a3fc6b51734e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Creating volume 8a1915e1-4dfd-4547-a1cb-17e1fa136b20 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:45:00 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:00 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22b44e6e-b8a4-4877-84e8-ba73fdb424a7" returned: 0 in 0.548s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:00 devstack sudo[90221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20 1073741824 Sep 07 13:45:00 devstack sudo[90221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Lock "cinder-quobyte-22b44e6e-b8a4-4877-84e8-ba73fdb424a7" released by "delete_volume" :: held 1.292s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Created reservations ['71f1ef2e-36c4-4337-a598-52cce6756367', '106d3095-c5d7-404b-b4f1-628648eaf2a9', '2b4a24c0-5d22-408f-91c6-4a9dfe7d6bc6', '415e66f8-2fe8-4e4b-8c25-dfaceebba3b0'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:00 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:45:00 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:01 devstack sudo[90221]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20 1073741824" returned: 0 in 0.684s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:01 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.433s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:01 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:45:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Deleted volume successfully. Sep 07 13:45:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-44ac681f-ee11-4d09-91e4-1b36c6ba8f2b tempest-VolumeQuotasAdminTestJSON-217352631 None] Lock "cinder-22b44e6e-b8a4-4877-84e8-ba73fdb424a7-delete_volume" released by "delete_volume" :: held 2.236s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:01 devstack sudo[90234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20 Sep 07 13:45:01 devstack sudo[90234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:01 devstack sudo[90234]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20" returned: 0 in 0.567s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:45:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.433s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67aa2a78-68a6-43ce-866e-fb4c88d8ba60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195ef0bf-d833-41c6-8d7f-9271bd5965f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:02 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Volume volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20 (8a1915e1-4dfd-4547-a1cb-17e1fa136b20): created successfully Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195ef0bf-d833-41c6-8d7f-9271bd5965f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Flow 'volume_create_manager' (5bdec124-bbcf-4374-93a6-10db5b0fe830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:02 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5e109a69-00a3-4c0f-ad91-ccb12de287b8 tempest-ServerActionsTestOtherA-1927182931 None] Created volume successfully. Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Flow 'volume_create_manager' (6882c983-9373-4f2c-b7dc-496914b6607f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccd6d89-8d11-48d4-b258-053b5ba3a6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ccd6d89-8d11-48d4-b258-053b5ba3a6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1583728371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7682b7b9-be60-41f5-ae59-ec4615c70665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ffad8abafe04a32965dc097dfffaea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:03Z,use_quota=True,user_id='a45a2ef454124cdda728d54a26656a27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a720ec0f-a6e7-4c34-890c-6fbcd90235fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a720ec0f-a6e7-4c34-890c-6fbcd90235fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99aa055b-1157-40c7-af66-7f0be5e7682f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99aa055b-1157-40c7-af66-7f0be5e7682f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7682b7b9-be60-41f5-ae59-ec4615c70665', 'volume_name': 'volume-7682b7b9-be60-41f5-ae59-ec4615c70665', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2647e06-75e2-4083-8b77-07af60580364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2647e06-75e2-4083-8b77-07af60580364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2bd0460-000f-49b0-81eb-db45effce822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:02 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Volume 7682b7b9-be60-41f5-ae59-ec4615c70665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7682b7b9-be60-41f5-ae59-ec4615c70665', 'volume_size': 1} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1583728371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7682b7b9-be60-41f5-ae59-ec4615c70665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ffad8abafe04a32965dc097dfffaea7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:03Z,use_quota=True,user_id='a45a2ef454124cdda728d54a26656a27',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Creating volume 7682b7b9-be60-41f5-ae59-ec4615c70665 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:45:02 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:45:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7682b7b9-be60-41f5-ae59-ec4615c70665 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:02 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7682b7b9-be60-41f5-ae59-ec4615c70665 1073741824 Sep 07 13:45:02 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Flow 'volume_create_manager' (4b5a9e98-e4da-4d5f-9e13-ac78976ef1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd82dc6-aa6a-4782-8e95-dcdf2fb2b793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dd82dc6-aa6a-4782-8e95-dcdf2fb2b793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1652079842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934877b8-62b5-4c93-9c5b-7ae1c71dcd3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07d52b908d0444da242e52cf609d010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:03Z,use_quota=True,user_id='fcc88c017cea41acac2c9ad36fdc34ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8c81df-b888-4c5a-9a00-dffebe9d2cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c8c81df-b888-4c5a-9a00-dffebe9d2cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04308213-4c71-4f8e-8f45-69b934524b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04308213-4c71-4f8e-8f45-69b934524b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '934877b8-62b5-4c93-9c5b-7ae1c71dcd3d', 'volume_name': 'volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3a581c-3a8e-4647-aada-64e5b55db84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3a581c-3a8e-4647-aada-64e5b55db84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07144aa0-5cd5-490c-8913-77b0849a3a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:03 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Volume 934877b8-62b5-4c93-9c5b-7ae1c71dcd3d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d', 'volume_size': 1} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:03 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7682b7b9-be60-41f5-ae59-ec4615c70665 1073741824" returned: 0 in 0.477s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7682b7b9-be60-41f5-ae59-ec4615c70665 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:03 devstack sudo[90243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7682b7b9-be60-41f5-ae59-ec4615c70665 Sep 07 13:45:03 devstack sudo[90243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:03 devstack sudo[90243]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7682b7b9-be60-41f5-ae59-ec4615c70665" returned: 0 in 0.402s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1652079842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=934877b8-62b5-4c93-9c5b-7ae1c71dcd3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f07d52b908d0444da242e52cf609d010',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:03Z,use_quota=True,user_id='fcc88c017cea41acac2c9ad36fdc34ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Creating volume 934877b8-62b5-4c93-9c5b-7ae1c71dcd3d {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:45:03 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:03 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d 1073741824 Sep 07 13:45:03 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2bd0460-000f-49b0-81eb-db45effce822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7682b7b9-be60-41f5-ae59-ec4615c70665', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd188a3-b8d4-486d-ae7c-94963c4a65d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:03 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Volume volume-7682b7b9-be60-41f5-ae59-ec4615c70665 (7682b7b9-be60-41f5-ae59-ec4615c70665): created successfully Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd188a3-b8d4-486d-ae7c-94963c4a65d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Flow 'volume_create_manager' (6882c983-9373-4f2c-b7dc-496914b6607f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:03 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0a5a3d90-c285-4bae-bbc3-2d7c85ce1b92 tempest-VolumeQuotasAdminTestJSON-217352631 None] Created volume successfully. Sep 07 13:45:04 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d 1073741824" returned: 0 in 0.661s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:04 devstack sudo[90251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d Sep 07 13:45:04 devstack sudo[90251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:04 devstack sudo[90251]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d" returned: 0 in 0.328s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:45:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07144aa0-5cd5-490c-8913-77b0849a3a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1fa2f7-d5bb-4a5b-b28e-74d7ac2143b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:04 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Volume volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d (934877b8-62b5-4c93-9c5b-7ae1c71dcd3d): created successfully Sep 07 13:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f1fa2f7-d5bb-4a5b-b28e-74d7ac2143b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Flow 'volume_create_manager' (4b5a9e98-e4da-4d5f-9e13-ac78976ef1f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4e904e6e-0fc0-4e55-a016-c8fcef478a13 tempest-DeleteServersTestJSON-975055392 None] Created volume successfully. Sep 07 13:45:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c6c39807-91f7-41c4-be35-98129278abdf tempest-VolumeQuotasAdminTestJSON-274309581 None] Transfer volume completed successfully. Sep 07 13:45:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-0f811460-0302-43e2-bcae-16a8bd8bac6a req-139e1842-e232-4931-8c4f-2fb1491bf1bf tempest-DeleteServersTestJSON-975055392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-0f811460-0302-43e2-bcae-16a8bd8bac6a req-139e1842-e232-4931-8c4f-2fb1491bf1bf tempest-DeleteServersTestJSON-975055392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Acquiring lock "cinder-7682b7b9-be60-41f5-ae59-ec4615c70665-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-0f811460-0302-43e2-bcae-16a8bd8bac6a req-139e1842-e232-4931-8c4f-2fb1491bf1bf tempest-DeleteServersTestJSON-975055392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.060s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Lock "cinder-7682b7b9-be60-41f5-ae59-ec4615c70665-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Acquiring lock "cinder-quobyte-7682b7b9-be60-41f5-ae59-ec4615c70665" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-0f811460-0302-43e2-bcae-16a8bd8bac6a req-139e1842-e232-4931-8c4f-2fb1491bf1bf tempest-DeleteServersTestJSON-975055392 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41f9b6ed-550e-48e8-b4e6-2ee5db0b3db9', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:45:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Lock "cinder-quobyte-7682b7b9-be60-41f5-ae59-ec4615c70665" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ff3061-8b95-42f6-9376-bd27e077f24c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:45:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7682b7b9-be60-41f5-ae59-ec4615c70665 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-0f811460-0302-43e2-bcae-16a8bd8bac6a req-139e1842-e232-4931-8c4f-2fb1491bf1bf tempest-DeleteServersTestJSON-975055392 None] attachment_update completed successfully. Sep 07 13:45:07 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7682b7b9-be60-41f5-ae59-ec4615c70665 Sep 07 13:45:07 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:08 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7682b7b9-be60-41f5-ae59-ec4615c70665" returned: 0 in 0.790s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7682b7b9-be60-41f5-ae59-ec4615c70665 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:08 devstack sudo[90554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7682b7b9-be60-41f5-ae59-ec4615c70665 Sep 07 13:45:08 devstack sudo[90554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:08 devstack sudo[90554]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7682b7b9-be60-41f5-ae59-ec4615c70665" returned: 0 in 0.534s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Lock "cinder-quobyte-7682b7b9-be60-41f5-ae59-ec4615c70665" released by "delete_volume" :: held 1.406s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Created reservations ['9fc88355-74a0-4d83-a196-7f8f0ce7aedf', '3d9223d3-6dd3-4cf7-94b2-d6e0a715aed8', '4e9b8db5-fa05-486c-b872-6d3755e619a6', '46172ea3-91e9-4ab4-af33-17fbcc6698c1'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:45:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:09 devstack sudo[90684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:45:09 devstack sudo[90684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:09 devstack sudo[90684]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.481s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:09 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:45:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Deleted volume successfully. Sep 07 13:45:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0541245b-d995-4f71-82f7-1e2bf7660507 tempest-VolumeQuotasAdminTestJSON-1087575544 None] Lock "cinder-7682b7b9-be60-41f5-ae59-ec4615c70665-delete_volume" released by "delete_volume" :: held 2.419s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:13 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-de3b719a-4124-41cd-aa38-b6d22f59cbf4 req-a8c0d001-2c7a-4a30-9ef4-eaf06606410b tempest-DeleteServersTestJSON-975055392 None] Terminate volume connection completed successfully. Sep 07 13:45:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-de3b719a-4124-41cd-aa38-b6d22f59cbf4 req-a8c0d001-2c7a-4a30-9ef4-eaf06606410b tempest-DeleteServersTestJSON-975055392 None] Deleting attachment 41f9b6ed-550e-48e8-b4e6-2ee5db0b3db9. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:45:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Acquiring lock "cinder-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Lock "cinder-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Acquiring lock "cinder-quobyte-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Lock "cinder-quobyte-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:16 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4992011-5eea-4080-a861-2baaf5f277c8]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:45:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:16 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d Sep 07 13:45:16 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:16 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d" returned: 0 in 0.700s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:16 devstack sudo[90792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d Sep 07 13:45:16 devstack sudo[90792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:17 devstack sudo[90792]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d" returned: 0 in 0.697s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Lock "cinder-quobyte-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d" released by "delete_volume" :: held 1.476s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:17 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Created reservations ['6963f2cc-3b57-4dc6-85ad-8eb7b94171d6', '4701d57b-31b7-4b45-99f6-2891880a8e2e', '10a3be8e-71c7-4f75-97ff-60f39cd76259', '4f1ab6b6-2a85-4e28-bfbe-a69f4fe58ca5'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:45:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:17 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:45:17 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:18 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.408s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:18 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:45:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Deleted volume successfully. Sep 07 13:45:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3c6cc629-be88-430b-b822-5df83dc0d076 tempest-DeleteServersTestJSON-975055392 None] Lock "cinder-934877b8-62b5-4c93-9c5b-7ae1c71dcd3d-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Flow 'volume_create_manager' (7a80545d-2f3f-4d10-acf0-8d44417cae48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077238bc-5ead-4aa5-8d80-79cc154ac5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (077238bc-5ead-4aa5-8d80-79cc154ac5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1038313817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c0e9b4-4e20-4838-b832-06d7333f35bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14569a9ff4864a94872267cde46a61dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:24Z,use_quota=True,user_id='a1c5dc30bb0840199e081b3be3125e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2678b0c3-38fd-4c7c-84c9-8007cde738b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2678b0c3-38fd-4c7c-84c9-8007cde738b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097a0182-8aa5-4e87-b16a-2907002b129f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (097a0182-8aa5-4e87-b16a-2907002b129f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2c0e9b4-4e20-4838-b832-06d7333f35bd', 'volume_name': 'volume-e2c0e9b4-4e20-4838-b832-06d7333f35bd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72407b0a-0386-4bb1-aea0-74fea32e5657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72407b0a-0386-4bb1-aea0-74fea32e5657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af8d006-0923-4c9a-85c1-f4d9d9ba8b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:24 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Volume e2c0e9b4-4e20-4838-b832-06d7333f35bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2c0e9b4-4e20-4838-b832-06d7333f35bd', 'volume_size': 1} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1038313817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2c0e9b4-4e20-4838-b832-06d7333f35bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14569a9ff4864a94872267cde46a61dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:24Z,use_quota=True,user_id='a1c5dc30bb0840199e081b3be3125e6c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Creating volume e2c0e9b4-4e20-4838-b832-06d7333f35bd {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:45:24 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:45:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2c0e9b4-4e20-4838-b832-06d7333f35bd 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:24 devstack sudo[90806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2c0e9b4-4e20-4838-b832-06d7333f35bd 1073741824 Sep 07 13:45:24 devstack sudo[90806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:25 devstack sudo[90806]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2c0e9b4-4e20-4838-b832-06d7333f35bd 1073741824" returned: 0 in 0.538s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2c0e9b4-4e20-4838-b832-06d7333f35bd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:25 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2c0e9b4-4e20-4838-b832-06d7333f35bd Sep 07 13:45:25 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:25 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2c0e9b4-4e20-4838-b832-06d7333f35bd" returned: 0 in 0.291s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:45:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4af8d006-0923-4c9a-85c1-f4d9d9ba8b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2c0e9b4-4e20-4838-b832-06d7333f35bd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d804261e-3263-4485-b204-da164836c326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:26 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Volume volume-e2c0e9b4-4e20-4838-b832-06d7333f35bd (e2c0e9b4-4e20-4838-b832-06d7333f35bd): created successfully Sep 07 13:45:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d804261e-3263-4485-b204-da164836c326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Flow 'volume_create_manager' (7a80545d-2f3f-4d10-acf0-8d44417cae48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-21590d6f-8fc7-44d5-8dd6-7974eacabdea tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Created volume successfully. Sep 07 13:45:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:45:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:29 devstack sudo[90875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:45:29 devstack sudo[90875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:30 devstack sudo[90875]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.263s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:45:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 8 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:45:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Acquiring lock "cinder-e2c0e9b4-4e20-4838-b832-06d7333f35bd-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Lock "cinder-e2c0e9b4-4e20-4838-b832-06d7333f35bd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Acquiring lock "cinder-quobyte-e2c0e9b4-4e20-4838-b832-06d7333f35bd" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Lock "cinder-quobyte-e2c0e9b4-4e20-4838-b832-06d7333f35bd" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:30 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[131e8751-5ab2-492b-b5df-7a4a6b5417d9]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:45:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2c0e9b4-4e20-4838-b832-06d7333f35bd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:30 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2c0e9b4-4e20-4838-b832-06d7333f35bd Sep 07 13:45:30 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:31 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2c0e9b4-4e20-4838-b832-06d7333f35bd" returned: 0 in 0.361s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2c0e9b4-4e20-4838-b832-06d7333f35bd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:31 devstack sudo[90883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2c0e9b4-4e20-4838-b832-06d7333f35bd Sep 07 13:45:31 devstack sudo[90883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:31 devstack sudo[90883]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2c0e9b4-4e20-4838-b832-06d7333f35bd" returned: 0 in 0.294s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Lock "cinder-quobyte-e2c0e9b4-4e20-4838-b832-06d7333f35bd" released by "delete_volume" :: held 0.694s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:31 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Created reservations ['8562f28e-9621-48b3-8cf9-95efbf238f23', '51694380-a24f-4f09-a865-99033ff022ff', '2a84a909-ac77-44c5-abc3-5cfb3092abed', 'cbb58a12-57a9-4acc-8256-785c1a6f04fc'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:45:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:31 devstack sudo[90886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:45:31 devstack sudo[90886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:31 devstack sudo[90886]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.290s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:31 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:45:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Deleted volume successfully. Sep 07 13:45:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d58b51da-9e21-4384-8917-cb5e9ce2f7db tempest-VolumeQuotasNegativeTestJSON-1600993674 None] Lock "cinder-e2c0e9b4-4e20-4838-b832-06d7333f35bd-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:41 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=47,cinder:UPDATE=60,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:45:41 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=54,cinder:SELECT=40,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Flow 'volume_create_manager' (628b2e1d-7ca1-4e37-bdf7-4f82163b4c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996ea305-8a34-4a1e-b14c-612cb4a22fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996ea305-8a34-4a1e-b14c-612cb4a22fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-536119521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582f2daa-db09-48af-9e79-fde9d4756c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b2702e573b3455d86b46d4b5b539797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:45Z,use_quota=True,user_id='d7abf5c99ab7455f90308c1feea43c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a859ac43-981c-492c-b129-9a6da2fa696c),volume_type_id=a859ac43-981c-492c-b129-9a6da2fa696c)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723d346f-91ac-4fc2-86cf-4be1ad2d3e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (723d346f-91ac-4fc2-86cf-4be1ad2d3e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a1d23f-2f01-41d5-aebb-b160443f3758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40a1d23f-2f01-41d5-aebb-b160443f3758) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '582f2daa-db09-48af-9e79-fde9d4756c6b', 'volume_name': 'volume-582f2daa-db09-48af-9e79-fde9d4756c6b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bec291-3908-49b0-ae3d-bb95e0ff9bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32bec291-3908-49b0-ae3d-bb95e0ff9bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc206e5-907d-4875-939a-f9a9b7be9a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Volume 582f2daa-db09-48af-9e79-fde9d4756c6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-582f2daa-db09-48af-9e79-fde9d4756c6b', 'volume_size': 1} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:45:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-536119521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=582f2daa-db09-48af-9e79-fde9d4756c6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b2702e573b3455d86b46d4b5b539797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:45:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:45:45Z,use_quota=True,user_id='d7abf5c99ab7455f90308c1feea43c6e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a859ac43-981c-492c-b129-9a6da2fa696c),volume_type_id=a859ac43-981c-492c-b129-9a6da2fa696c)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Creating volume 582f2daa-db09-48af-9e79-fde9d4756c6b {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:45:44 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:45:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-582f2daa-db09-48af-9e79-fde9d4756c6b 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:44 devstack sudo[90933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-582f2daa-db09-48af-9e79-fde9d4756c6b 1073741824 Sep 07 13:45:44 devstack sudo[90933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:45 devstack sudo[90933]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-582f2daa-db09-48af-9e79-fde9d4756c6b 1073741824" returned: 0 in 0.621s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-582f2daa-db09-48af-9e79-fde9d4756c6b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:45 devstack sudo[90944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-582f2daa-db09-48af-9e79-fde9d4756c6b Sep 07 13:45:45 devstack sudo[90944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:45 devstack sudo[90944]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-b8042c11-d964-4708-b467-5d120755ed51 req-50f7132d-103a-480c-8d73-d4f8538b3603 tempest-ServerActionsTestOtherA-1927182931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-582f2daa-db09-48af-9e79-fde9d4756c6b" returned: 0 in 0.324s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:45:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-b8042c11-d964-4708-b467-5d120755ed51 req-50f7132d-103a-480c-8d73-d4f8538b3603 tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-b8042c11-d964-4708-b467-5d120755ed51 req-50f7132d-103a-480c-8d73-d4f8538b3603 tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc206e5-907d-4875-939a-f9a9b7be9a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-582f2daa-db09-48af-9e79-fde9d4756c6b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905efa8b-2676-4597-a300-b56f5f5c09c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:45:45 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Volume volume-582f2daa-db09-48af-9e79-fde9d4756c6b (582f2daa-db09-48af-9e79-fde9d4756c6b): created successfully Sep 07 13:45:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905efa8b-2676-4597-a300-b56f5f5c09c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:45:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Flow 'volume_create_manager' (628b2e1d-7ca1-4e37-bdf7-4f82163b4c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:45:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b9f25def-9776-4744-8e80-04d008dad308 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Created volume successfully. Sep 07 13:45:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-b8042c11-d964-4708-b467-5d120755ed51 req-50f7132d-103a-480c-8d73-d4f8538b3603 tempest-ServerActionsTestOtherA-1927182931 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0dca0210-64c9-4479-b3af-e5603179f4a6', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:45:46 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-b8042c11-d964-4708-b467-5d120755ed51 req-50f7132d-103a-480c-8d73-d4f8538b3603 tempest-ServerActionsTestOtherA-1927182931 None] attachment_update completed successfully. Sep 07 13:45:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4c09e2f5-b8a7-45cf-add4-1ccfeca1bb55 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4c09e2f5-b8a7-45cf-add4-1ccfeca1bb55 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4c09e2f5-b8a7-45cf-add4-1ccfeca1bb55 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4c09e2f5-b8a7-45cf-add4-1ccfeca1bb55 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4c09e2f5-b8a7-45cf-add4-1ccfeca1bb55 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c09e2f5-b8a7-45cf-add4-1ccfeca1bb55 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:47 devstack sudo[91340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:45:47 devstack sudo[91340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:47 devstack sudo[91340]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c09e2f5-b8a7-45cf-add4-1ccfeca1bb55 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.390s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:47 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-4c09e2f5-b8a7-45cf-add4-1ccfeca1bb55 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:45:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4c09e2f5-b8a7-45cf-add4-1ccfeca1bb55 tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Retype volume completed successfully. Sep 07 13:45:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Acquiring lock "cinder-582f2daa-db09-48af-9e79-fde9d4756c6b-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Lock "cinder-582f2daa-db09-48af-9e79-fde9d4756c6b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Acquiring lock "cinder-quobyte-582f2daa-db09-48af-9e79-fde9d4756c6b" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:45:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Lock "cinder-quobyte-582f2daa-db09-48af-9e79-fde9d4756c6b" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:45:49 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c2a191-9388-4deb-b90b-ac1047a35214]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:45:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-582f2daa-db09-48af-9e79-fde9d4756c6b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:49 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-582f2daa-db09-48af-9e79-fde9d4756c6b Sep 07 13:45:49 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:49 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-582f2daa-db09-48af-9e79-fde9d4756c6b" returned: 0 in 0.627s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-582f2daa-db09-48af-9e79-fde9d4756c6b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:49 devstack sudo[91363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-582f2daa-db09-48af-9e79-fde9d4756c6b Sep 07 13:45:49 devstack sudo[91363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:50 devstack sudo[91363]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-582f2daa-db09-48af-9e79-fde9d4756c6b" returned: 0 in 0.642s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Lock "cinder-quobyte-582f2daa-db09-48af-9e79-fde9d4756c6b" released by "delete_volume" :: held 1.335s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:50 devstack cinder-volume[87444]: WARNING cinder.quota [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:45:50 devstack cinder-volume[87444]: WARNING cinder.quota [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:45:50 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Created reservations ['181a1ace-abb5-45fc-bb6b-653ff3967d86', '01c2eacb-004c-4c77-ab30-fc6640f8f7ee', 'cb326ae8-d66e-4ade-9b16-5c1d933aa657', '21c4ff79-4971-4736-95eb-159a8f37ee54'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:45:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:45:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:45:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:45:50 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:45:50 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:45:51 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Sep 07 13:45:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.717s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:45:51 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:45:51 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Deleted volume successfully. Sep 07 13:45:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-eb1eb422-9ac2-4197-8537-cb521076bdaa tempest-VolumeRetypeWithoutMigrationTest-1563975271 None] Lock "cinder-582f2daa-db09-48af-9e79-fde9d4756c6b-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:45:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-5c979356-1214-4b02-8dda-88681e12f875 req-07bde021-cf5d-4b98-9926-02b8b719c6c5 tempest-ServerActionsTestOtherA-1927182931 None] Terminate volume connection completed successfully. Sep 07 13:45:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-5c979356-1214-4b02-8dda-88681e12f875 req-07bde021-cf5d-4b98-9926-02b8b719c6c5 tempest-ServerActionsTestOtherA-1927182931 None] Deleting attachment 0dca0210-64c9-4479-b3af-e5603179f4a6. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:45:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-5c979356-1214-4b02-8dda-88681e12f875 req-bf23a766-bad5-4275-a4db-6533227a7f15 tempest-ServerActionsTestOtherA-1927182931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:45:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-5c979356-1214-4b02-8dda-88681e12f875 req-bf23a766-bad5-4275-a4db-6533227a7f15 tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:45:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-5c979356-1214-4b02-8dda-88681e12f875 req-bf23a766-bad5-4275-a4db-6533227a7f15 tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:45:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-5c979356-1214-4b02-8dda-88681e12f875 req-bf23a766-bad5-4275-a4db-6533227a7f15 tempest-ServerActionsTestOtherA-1927182931 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a55ae20-d4bf-4ee8-b184-d3aa04b166d2', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:45:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-5c979356-1214-4b02-8dda-88681e12f875 req-bf23a766-bad5-4275-a4db-6533227a7f15 tempest-ServerActionsTestOtherA-1927182931 None] attachment_update completed successfully. Sep 07 13:46:04 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=31,cinder:UPDATE=16,cinder:INSERT=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:46:04 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=21,cinder:SELECT=25,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:46:10 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:46:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Flow 'volume_create_manager' (d6c91a7e-f6c4-42b1-88d8-0493a28aea13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5373dc0-1f84-4d80-8161-59ed4fa4a7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5373dc0-1f84-4d80-8161-59ed4fa4a7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1663593221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be7ec110-1d9f-4836-83de-3bbad380f5dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc1f6239959b46e790d09adf0f8d6051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:10Z,use_quota=True,user_id='5b30f29f195b4f58aaf7c14db4ac50ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f60bb2b-11ed-4ef5-9c2a-7f478e72c2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f60bb2b-11ed-4ef5-9c2a-7f478e72c2c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (892c5c5b-ad20-4c87-a53f-602be945f777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:10 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 13:46:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (892c5c5b-ad20-4c87-a53f-602be945f777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'be7ec110-1d9f-4836-83de-3bbad380f5dc', 'volume_name': 'volume-be7ec110-1d9f-4836-83de-3bbad380f5dc', 'volume_size': 1, 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e02e283d554267ad4387462fa3cb7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'created_at': datetime.datetime(2026, 9, 7, 11, 36, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09f2352e-bb3e-4924-9aca-b02c5284d704/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72476440-ea92-4f26-9c43-024801e660c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72476440-ea92-4f26-9c43-024801e660c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f411be-4eef-4f5b-ad78-c093cad57432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:11 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Volume be7ec110-1d9f-4836-83de-3bbad380f5dc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-be7ec110-1d9f-4836-83de-3bbad380f5dc', 'volume_size': 1, 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e02e283d554267ad4387462fa3cb7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'created_at': datetime.datetime(2026, 9, 7, 11, 36, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09f2352e-bb3e-4924-9aca-b02c5284d704/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 13:46:11 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Trying to clone be7ec110-1d9f-4836-83de-3bbad380f5dc from image 09f2352e-bb3e-4924-9aca-b02c5284d704 at location (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 13:46:12 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_pty_6kz9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 13:46:12 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Image download 20.69 MB at 20.69 MB/s Sep 07 13:46:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a810a16-35af-4940-a3c3-d24600fd8adf]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_pty_6kz9devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:12 devstack sudo[92158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_pty_6kz9devstack@QuobyteHD Sep 07 13:46:12 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:12 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_pty_6kz9devstack@QuobyteHD" returned: 0 in 0.618s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:12 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Temporary image 09f2352e-bb3e-4924-9aca-b02c5284d704 is fetched for user 5b30f29f195b4f58aaf7c14db4ac50ba. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 13:46:13 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[82186027-d041-45b6-b3d2-f77a32565120]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_pty_6kz9devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:13 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_pty_6kz9devstack@QuobyteHD Sep 07 13:46:13 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:13 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_pty_6kz9devstack@QuobyteHD" returned: 0 in 0.663s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1663593221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be7ec110-1d9f-4836-83de-3bbad380f5dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc1f6239959b46e790d09adf0f8d6051',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:10Z,use_quota=True,user_id='5b30f29f195b4f58aaf7c14db4ac50ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:46:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Creating volume be7ec110-1d9f-4836-83de-3bbad380f5dc {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:46:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:46:13 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:46:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:13 devstack sudo[92198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc 1073741824 Sep 07 13:46:13 devstack sudo[92198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:14 devstack sudo[92198]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc 1073741824" returned: 0 in 0.849s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:14 devstack sudo[92204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc Sep 07 13:46:14 devstack sudo[92204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:15 devstack sudo[92204]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc" returned: 0 in 0.501s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:46:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.455s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:15 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Attempting download of 09f2352e-bb3e-4924-9aca-b02c5284d704 ((None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}])) to volume be7ec110-1d9f-4836-83de-3bbad380f5dc. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 13:46:15 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c6f763-86ec-4cd2-8450-e557da15a8ef]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_v987u9vr {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:15 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_v987u9vr Sep 07 13:46:15 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:16 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_v987u9vr" returned: 0 in 0.757s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_v987u9vr {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:16 devstack sudo[92238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_v987u9vr Sep 07 13:46:16 devstack sudo[92238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:16 devstack sudo[92238]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_v987u9vr" returned: 1 in 0.545s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_v987u9vr' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:46:16 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[128f8e61-56d5-461a-ba9c-1dfea2209001]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_pty_6kz9devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:16 devstack sudo[92242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_pty_6kz9devstack@QuobyteHD Sep 07 13:46:16 devstack sudo[92242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:17 devstack sudo[92242]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_pty_6kz9devstack@QuobyteHD" returned: 0 in 0.589s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:17 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] 09f2352e-bb3e-4924-9aca-b02c5284d704 was qcow2, converting to qcow2 {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 13:46:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_pty_6kz9devstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:17 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_pty_6kz9devstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc Sep 07 13:46:17 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Flow 'volume_create_manager' (fccb855a-fd13-4ab6-a5b9-144855d3cb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fc15ea-a3f8-4ccb-9316-bc64184af672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fc15ea-a3f8-4ccb-9316-bc64184af672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1948986958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d1c6978-ebd6-45e8-ab70-3ba264daf800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b27bf9537394e5286228382d27baa9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:19Z,use_quota=True,user_id='177a47b77e7142a48853d67c846e4075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111a9b36-c0de-47d1-8dfc-9188759a6d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (111a9b36-c0de-47d1-8dfc-9188759a6d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0dc141-de93-4837-9d9a-7d53f46bfc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b0dc141-de93-4837-9d9a-7d53f46bfc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d1c6978-ebd6-45e8-ab70-3ba264daf800', 'volume_name': 'volume-7d1c6978-ebd6-45e8-ab70-3ba264daf800', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e246d1-f22b-49da-a62a-c5c660c0adf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9e246d1-f22b-49da-a62a-c5c660c0adf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e4bdb6-af98-400d-93c6-e7adbb3d18b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:19 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Volume 7d1c6978-ebd6-45e8-ab70-3ba264daf800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d1c6978-ebd6-45e8-ab70-3ba264daf800', 'volume_size': 1} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1948986958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d1c6978-ebd6-45e8-ab70-3ba264daf800,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b27bf9537394e5286228382d27baa9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:19Z,use_quota=True,user_id='177a47b77e7142a48853d67c846e4075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Creating volume 7d1c6978-ebd6-45e8-ab70-3ba264daf800 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:46:19 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d1c6978-ebd6-45e8-ab70-3ba264daf800 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:19 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d1c6978-ebd6-45e8-ab70-3ba264daf800 1073741824 Sep 07 13:46:19 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:19 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d1c6978-ebd6-45e8-ab70-3ba264daf800 1073741824" returned: 0 in 0.757s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d1c6978-ebd6-45e8-ab70-3ba264daf800 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:19 devstack sudo[92294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d1c6978-ebd6-45e8-ab70-3ba264daf800 Sep 07 13:46:19 devstack sudo[92294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:20 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_pty_6kz9devstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc" returned: 0 in 2.728s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_pty_6kz9devstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:46:20 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Converted 112.00 MB image at 41.03 MB/s Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:20 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc 1G Sep 07 13:46:20 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:20 devstack sudo[92294]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d1c6978-ebd6-45e8-ab70-3ba264daf800" returned: 0 in 0.394s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01e4bdb6-af98-400d-93c6-e7adbb3d18b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d1c6978-ebd6-45e8-ab70-3ba264daf800', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0553edda-d5c0-4d2c-9a0b-95925b41812c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:20 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Volume volume-7d1c6978-ebd6-45e8-ab70-3ba264daf800 (7d1c6978-ebd6-45e8-ab70-3ba264daf800): created successfully Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0553edda-d5c0-4d2c-9a0b-95925b41812c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Flow 'volume_create_manager' (fccb855a-fd13-4ab6-a5b9-144855d3cb18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2577f8ae-298d-481a-a253-623bf40a2892 tempest-ServerRescueNegativeTestJSON-1499909783 None] Created volume successfully. Sep 07 13:46:20 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc 1G" returned: 0 in 0.516s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Downloaded image 09f2352e-bb3e-4924-9aca-b02c5284d704 ((None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}])) to volume be7ec110-1d9f-4836-83de-3bbad380f5dc successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Temporary image 09f2352e-bb3e-4924-9aca-b02c5284d704 for user 5b30f29f195b4f58aaf7c14db4ac50ba is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Marking volume be7ec110-1d9f-4836-83de-3bbad380f5dc as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Copying metadata from image 09f2352e-bb3e-4924-9aca-b02c5284d704 to be7ec110-1d9f-4836-83de-3bbad380f5dc. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Creating volume glance metadata for volume be7ec110-1d9f-4836-83de-3bbad380f5dc backed by image 09f2352e-bb3e-4924-9aca-b02c5284d704 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45f411be-4eef-4f5b-ad78-c093cad57432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be7ec110-1d9f-4836-83de-3bbad380f5dc', 'volume_size': 1, 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e02e283d554267ad4387462fa3cb7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'created_at': datetime.datetime(2026, 9, 7, 11, 36, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09f2352e-bb3e-4924-9aca-b02c5284d704/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a461f351-152e-4a7c-a631-f57bc34efb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:20 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Volume volume-be7ec110-1d9f-4836-83de-3bbad380f5dc (be7ec110-1d9f-4836-83de-3bbad380f5dc): created successfully Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a461f351-152e-4a7c-a631-f57bc34efb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Flow 'volume_create_manager' (d6c91a7e-f6c4-42b1-88d8-0493a28aea13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-25d5c91b-fdfe-4be2-960e-ffaa3859047e tempest-VolumesImageMetadata-2133615853 None] Created volume successfully. Sep 07 13:46:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Acquiring lock "cinder-be7ec110-1d9f-4836-83de-3bbad380f5dc-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Lock "cinder-be7ec110-1d9f-4836-83de-3bbad380f5dc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Acquiring lock "cinder-quobyte-be7ec110-1d9f-4836-83de-3bbad380f5dc" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Lock "cinder-quobyte-be7ec110-1d9f-4836-83de-3bbad380f5dc" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41028d3-56ab-4255-b783-2627d8f7556c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:22 devstack sudo[92338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc Sep 07 13:46:22 devstack sudo[92338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:23 devstack sudo[92338]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc" returned: 0 in 0.486s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:23 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc Sep 07 13:46:23 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:23 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-be7ec110-1d9f-4836-83de-3bbad380f5dc" returned: 0 in 0.431s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Lock "cinder-quobyte-be7ec110-1d9f-4836-83de-3bbad380f5dc" released by "delete_volume" :: held 0.990s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:23 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Created reservations ['5f8ad3ae-5f88-4109-92ca-b7df502ec454', '28017f95-fe94-429e-8bb5-759145d6a8e1', 'fd8d22b7-e83d-40c6-8b6c-918ecbc60205', '6e71cf8c-aa52-4bf9-b983-77d515f0fa83'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:23 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:46:23 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:24 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.366s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:24 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:46:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Deleted volume successfully. Sep 07 13:46:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-829a708a-f74d-42da-94ef-f6466b987ef4 tempest-VolumesImageMetadata-2133615853 None] Lock "cinder-be7ec110-1d9f-4836-83de-3bbad380f5dc-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:46:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:29 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:46:29 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:30 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.600s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:46:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:46:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:46:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:46:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-51dcc29e-a49b-44eb-a06a-eb1398d43cf7 req-9e1e11d6-0fb6-49c6-883b-f9b057243baf tempest-ServerActionsTestOtherA-1927182931 None] Terminate volume connection completed successfully. Sep 07 13:46:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-51dcc29e-a49b-44eb-a06a-eb1398d43cf7 req-9e1e11d6-0fb6-49c6-883b-f9b057243baf tempest-ServerActionsTestOtherA-1927182931 None] Deleting attachment 0a55ae20-d4bf-4ee8-b184-d3aa04b166d2. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:46:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Acquiring lock "cinder-7d1c6978-ebd6-45e8-ab70-3ba264daf800-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Lock "cinder-7d1c6978-ebd6-45e8-ab70-3ba264daf800-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Acquiring lock "cinder-quobyte-7d1c6978-ebd6-45e8-ab70-3ba264daf800" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Lock "cinder-quobyte-7d1c6978-ebd6-45e8-ab70-3ba264daf800" acquired by "delete_volume" :: waited 0.088s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:32 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5a96a4-7843-4028-ba15-39a12864cbf8]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d1c6978-ebd6-45e8-ab70-3ba264daf800 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:33 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d1c6978-ebd6-45e8-ab70-3ba264daf800 Sep 07 13:46:33 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:33 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Flow 'volume_create_manager' (bb954e86-9530-43bb-bb08-be8a205f109e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c301d6c8-cacf-4494-9e93-203414d9d78a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:34 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d1c6978-ebd6-45e8-ab70-3ba264daf800" returned: 0 in 1.144s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d1c6978-ebd6-45e8-ab70-3ba264daf800 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c301d6c8-cacf-4494-9e93-203414d9d78a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-870872256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d12c32733042ef8eccf9071830795c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:34Z,use_quota=True,user_id='59ed33909b6948c5919d7cb2597149e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373d2d2a-43b6-4a9d-8b5d-8187a44fe19d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:34 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d1c6978-ebd6-45e8-ab70-3ba264daf800 Sep 07 13:46:34 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (373d2d2a-43b6-4a9d-8b5d-8187a44fe19d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48125265-c99c-4129-bc4a-4ce41359b51f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48125265-c99c-4129-bc4a-4ce41359b51f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf', 'volume_name': 'volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02d470f-7728-4e53-aade-7442a93c6adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a02d470f-7728-4e53-aade-7442a93c6adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e518fa4-99a9-4b5d-97a7-cf9d694aa83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:34 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Volume 798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf', 'volume_size': 1} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-870872256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42d12c32733042ef8eccf9071830795c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:34Z,use_quota=True,user_id='59ed33909b6948c5919d7cb2597149e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Creating volume 798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:46:34 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:34 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf 1073741824 Sep 07 13:46:34 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:34 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d1c6978-ebd6-45e8-ab70-3ba264daf800" returned: 0 in 0.692s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Lock "cinder-quobyte-7d1c6978-ebd6-45e8-ab70-3ba264daf800" released by "delete_volume" :: held 2.009s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:34 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Created reservations ['c6a9df01-0130-4cdc-a756-8d5d776e1f47', '3eff0c1f-36cf-4dc8-aef4-52ca2703ba01', '5bcd358c-7bb7-495f-b612-d3859cd943c4', 'f51e7382-e227-4df7-a102-9c88273e18c1'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:46:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:35 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf 1073741824" returned: 0 in 0.967s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:35 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:46:35 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:35 devstack sudo[92551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf Sep 07 13:46:35 devstack sudo[92551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:35 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.684s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:35 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:46:35 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Deleted volume successfully. Sep 07 13:46:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3969eb2b-8568-46cc-bf20-dad963396822 tempest-ServerRescueNegativeTestJSON-1499909783 None] Lock "cinder-7d1c6978-ebd6-45e8-ab70-3ba264daf800-delete_volume" released by "delete_volume" :: held 3.419s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:36 devstack sudo[92551]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf" returned: 0 in 0.729s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:46:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e518fa4-99a9-4b5d-97a7-cf9d694aa83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e403278c-88cf-4a73-af7f-90e17ff49a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:36 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Volume volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf (798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf): created successfully Sep 07 13:46:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e403278c-88cf-4a73-af7f-90e17ff49a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Flow 'volume_create_manager' (bb954e86-9530-43bb-bb08-be8a205f109e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:36 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5563c46e-801b-4adf-856d-4fe65dbc8a66 tempest-SnapshotMetadataTestJSON-587376722 None] Created volume successfully. Sep 07 13:46:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] Creating offline snapshot b2eb25df-d706-46b7-9a69-b8d6c57e873c of volume 798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:46:37 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d599f6-d675-4d79-aa4c-fe8fdfce55bc]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:38 devstack sudo[92587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf Sep 07 13:46:38 devstack sudo[92587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:38 devstack sudo[92587]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf" returned: 0 in 0.602s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:38 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c 1G Sep 07 13:46:38 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:39 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c 1G" returned: 0 in 1.033s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:39 devstack sudo[92603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c Sep 07 13:46:39 devstack sudo[92603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:40 devstack sudo[92603]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c" returned: 0 in 0.806s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:40 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c is being set with open permissions: ugo+rw Sep 07 13:46:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:40 devstack sudo[92608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c Sep 07 13:46:40 devstack sudo[92608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:40 devstack sudo[92608]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c" returned: 0 in 0.321s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:40 devstack sudo[92611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.info Sep 07 13:46:40 devstack sudo[92611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:41 devstack sudo[92611]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.info" returned: 0 in 0.373s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:41 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.info is being set with open permissions: ugo+rw Sep 07 13:46:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:41 devstack sudo[92615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.info Sep 07 13:46:41 devstack sudo[92615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:41 devstack sudo[92615]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.info" returned: 0 in 0.379s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.710s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:41 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0ea20186-dd24-484b-be16-323a19591c5e tempest-SnapshotMetadataTestJSON-587376722 None] Create snapshot completed successfully Sep 07 13:46:42 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:46:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Flow 'volume_create_manager' (429bb11e-c7cf-4269-85db-18008b2b8ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c9f6b4-4bb8-4df1-af06-c993bbdf4c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c9f6b4-4bb8-4df1-af06-c993bbdf4c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1829275218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1672c1bf-f331-473f-9e7c-4646524d4215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c423bd8652c4a07a37f5c7c1ae948cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:43Z,use_quota=True,user_id='773502c44bb8400890c2a3fc6b51734e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a086af-26ad-47f7-a866-1c0275c02efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3a086af-26ad-47f7-a866-1c0275c02efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed0670c-031f-4450-bb0b-6538feb62610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:42 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Acquiring lock "cinder-b2eb25df-d706-46b7-9a69-b8d6c57e873c-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Lock "cinder-b2eb25df-d706-46b7-9a69-b8d6c57e873c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Acquiring lock "cinder-quobyte-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Lock "cinder-quobyte-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Acquiring lock "cinder-quobyte-b2eb25df-d706-46b7-9a69-b8d6c57e873c" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Lock "cinder-quobyte-b2eb25df-d706-46b7-9a69-b8d6c57e873c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Deleting offline snapshot b2eb25df-d706-46b7-9a69-b8d6c57e873c of volume 798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] snapshot_file for this snap is: volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c15e44b-97b2-4ee0-af30-49e14502ce9b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ed0670c-031f-4450-bb0b-6538feb62610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1672c1bf-f331-473f-9e7c-4646524d4215', 'volume_name': 'volume-1672c1bf-f331-473f-9e7c-4646524d4215', 'volume_size': 1, 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e02e283d554267ad4387462fa3cb7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'created_at': datetime.datetime(2026, 9, 7, 11, 36, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09f2352e-bb3e-4924-9aca-b02c5284d704/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bf2953-edee-4173-a4e2-1787499f6ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bf2953-edee-4173-a4e2-1787499f6ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07e2c79-f600-45b5-a1f7-7cbf97f784ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:43 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Volume 1672c1bf-f331-473f-9e7c-4646524d4215: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1672c1bf-f331-473f-9e7c-4646524d4215', 'volume_size': 1, 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e02e283d554267ad4387462fa3cb7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'created_at': datetime.datetime(2026, 9, 7, 11, 36, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09f2352e-bb3e-4924-9aca-b02c5284d704/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Trying to clone 1672c1bf-f331-473f-9e7c-4646524d4215 from image 09f2352e-bb3e-4924-9aca-b02c5284d704 at location (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 13:46:43 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c Sep 07 13:46:43 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:43 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c" returned: 0 in 0.547s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_xjeorjladevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 13:46:43 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Image download 20.69 MB at 20.69 MB/s Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fe0eb8-717f-4c39-a67b-57df2cb12cd5]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b3365b-70b8-4d48-807c-c5d975804f31]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_xjeorjladevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:43 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf Sep 07 13:46:43 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:44 devstack sudo[92651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_xjeorjladevstack@QuobyteHD Sep 07 13:46:44 devstack sudo[92651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:44 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf" returned: 0 in 0.436s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:44 devstack sudo[92660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c Sep 07 13:46:44 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:44 devstack sudo[92651]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_xjeorjladevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Temporary image 09f2352e-bb3e-4924-9aca-b02c5284d704 is fetched for user 773502c44bb8400890c2a3fc6b51734e. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d927b71d-2aac-4469-8324-7b80f0877baa]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_xjeorjladevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:44 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_xjeorjladevstack@QuobyteHD Sep 07 13:46:44 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:44 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c" returned: 0 in 0.372s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:44 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c Sep 07 13:46:44 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:44 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_xjeorjladevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1829275218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1672c1bf-f331-473f-9e7c-4646524d4215,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c423bd8652c4a07a37f5c7c1ae948cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:43Z,use_quota=True,user_id='773502c44bb8400890c2a3fc6b51734e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Creating volume 1672c1bf-f331-473f-9e7c-4646524d4215 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:46:44 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:44 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215 1073741824 Sep 07 13:46:44 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:44 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf.b2eb25df-d706-46b7-9a69-b8d6c57e873c" returned: 0 in 0.291s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Lock "cinder-quobyte-b2eb25df-d706-46b7-9a69-b8d6c57e873c" released by "_delete_snapshot" :: held 1.793s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Lock "cinder-quobyte-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf" released by "delete_snapshot" :: held 1.823s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Created reservations ['85d1ad0d-afc7-4658-8c20-48809777e270', 'a03341a6-55fb-4253-ad84-5d6d47500f41', '9d20ad21-0b9d-48bb-97e3-a2dc6ba3e6a7', '284adcc8-7142-4745-9e91-07440a062edd'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:46:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Delete snapshot completed successfully. Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6652dcbc-344b-4e28-9bbb-bcdee8da6c32 tempest-SnapshotMetadataTestJSON-587376722 None] Lock "cinder-b2eb25df-d706-46b7-9a69-b8d6c57e873c-delete_snapshot" released by "delete_snapshot" :: held 2.008s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:45 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215 1073741824" returned: 0 in 0.519s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Acquiring lock "cinder-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Lock "cinder-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:45 devstack sudo[92682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215 Sep 07 13:46:45 devstack sudo[92682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Acquiring lock "cinder-quobyte-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Lock "cinder-quobyte-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a94c72-2e50-476a-84d6-a537c91941be]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:45 devstack sudo[92684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf Sep 07 13:46:45 devstack sudo[92684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:45 devstack sudo[92682]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215" returned: 0 in 0.319s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Attempting download of 09f2352e-bb3e-4924-9aca-b02c5284d704 ((None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}])) to volume 1672c1bf-f331-473f-9e7c-4646524d4215. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[16184f49-5d9e-40fb-aabf-6baf11842f2c]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_88on0eyy {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:45 devstack sudo[92687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_88on0eyy Sep 07 13:46:45 devstack sudo[92687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:45 devstack sudo[92684]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf" returned: 0 in 0.472s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:46 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf Sep 07 13:46:46 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:46 devstack sudo[92687]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_88on0eyy" returned: 0 in 0.386s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_88on0eyy {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:46 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf" returned: 0 in 0.277s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Lock "cinder-quobyte-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf" released by "delete_volume" :: held 0.814s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:46 devstack sudo[92697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_88on0eyy Sep 07 13:46:46 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Created reservations ['a7fbc7a6-455a-4780-8bd7-5ed7329001d8', '723a4c39-80af-4195-8ffc-85995064a349', '58536baa-fdcf-4206-ae8e-eaa0d290960b', '12f3038b-0eb4-4552-88b9-c7e87a5d7241'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:46 devstack sudo[92700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:46:46 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:46 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_88on0eyy" returned: 1 in 0.367s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_88on0eyy' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef98a51c-42a6-43d5-a049-65bfd0e65fba]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_xjeorjladevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:46 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_xjeorjladevstack@QuobyteHD Sep 07 13:46:46 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:46 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.319s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:46:46 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Deleted volume successfully. Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7056692c-80f3-435a-9a0f-5d9a397bca57 tempest-SnapshotMetadataTestJSON-587376722 None] Lock "cinder-798f41b5-7ec0-41e7-9bea-1ef7f2cc7ddf-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:46:46 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_xjeorjladevstack@QuobyteHD" returned: 0 in 0.420s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] 09f2352e-bb3e-4924-9aca-b02c5284d704 was qcow2, converting to qcow2 {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 13:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_xjeorjladevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:46 devstack sudo[92711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_xjeorjladevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215 Sep 07 13:46:46 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:49 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_xjeorjladevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215" returned: 0 in 2.214s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:49 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_xjeorjladevstack@QuobyteHD, size 112.00 MB, duration 2.22 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:46:49 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Converted 112.00 MB image at 50.56 MB/s Sep 07 13:46:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:49 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215 1G Sep 07 13:46:49 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:49 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215 1G" returned: 0 in 0.420s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:49 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Downloaded image 09f2352e-bb3e-4924-9aca-b02c5284d704 ((None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}])) to volume 1672c1bf-f331-473f-9e7c-4646524d4215 successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 13:46:49 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Temporary image 09f2352e-bb3e-4924-9aca-b02c5284d704 for user 773502c44bb8400890c2a3fc6b51734e is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 13:46:49 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Marking volume 1672c1bf-f331-473f-9e7c-4646524d4215 as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 13:46:49 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Copying metadata from image 09f2352e-bb3e-4924-9aca-b02c5284d704 to 1672c1bf-f331-473f-9e7c-4646524d4215. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 13:46:49 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Creating volume glance metadata for volume 1672c1bf-f331-473f-9e7c-4646524d4215 backed by image 09f2352e-bb3e-4924-9aca-b02c5284d704 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 13:46:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07e2c79-f600-45b5-a1f7-7cbf97f784ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1672c1bf-f331-473f-9e7c-4646524d4215', 'volume_size': 1, 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e02e283d554267ad4387462fa3cb7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'created_at': datetime.datetime(2026, 9, 7, 11, 36, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09f2352e-bb3e-4924-9aca-b02c5284d704/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6892b1-64e2-4b77-9b97-b7187cc2134e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:49 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Volume volume-1672c1bf-f331-473f-9e7c-4646524d4215 (1672c1bf-f331-473f-9e7c-4646524d4215): created successfully Sep 07 13:46:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6892b1-64e2-4b77-9b97-b7187cc2134e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Flow 'volume_create_manager' (429bb11e-c7cf-4269-85db-18008b2b8ad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-484c3173-f36f-4ddd-a402-571aca4a31fe tempest-ServerActionsTestOtherA-1927182931 None] Created volume successfully. Sep 07 13:46:51 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:46:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Flow 'volume_create_manager' (8902629b-c0f5-4f27-bf54-1ca3445b2f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08a6213-10b2-4fef-be4e-2ea55e8268f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e08a6213-10b2-4fef-be4e-2ea55e8268f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-153589046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ef2ffa858d54483b8939110f0b60a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:51Z,use_quota=True,user_id='1896324a9d9e48139838cfbd2dbb9db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc13717-e9bc-4dbd-859f-8f1a0f28599e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cc13717-e9bc-4dbd-859f-8f1a0f28599e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0bedf98-2e4b-486e-8fec-5d15e47057e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:51 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0bedf98-2e4b-486e-8fec-5d15e47057e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6', 'volume_name': 'volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6', 'volume_size': 1, 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e02e283d554267ad4387462fa3cb7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'created_at': datetime.datetime(2026, 9, 7, 11, 36, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09f2352e-bb3e-4924-9aca-b02c5284d704/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f0c2e2-d8b2-43ac-bfbf-d1069373fb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f0c2e2-d8b2-43ac-bfbf-d1069373fb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571687a4-4603-4766-bc64-26efd492d0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:52 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Volume c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6', 'volume_size': 1, 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e02e283d554267ad4387462fa3cb7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'created_at': datetime.datetime(2026, 9, 7, 11, 36, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09f2352e-bb3e-4924-9aca-b02c5284d704/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Trying to clone c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 from image 09f2352e-bb3e-4924-9aca-b02c5284d704 at location (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Flow 'volume_create_manager' (2badb408-79fe-4d51-991b-dc3e314eef4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be3da0a-22bd-4635-8859-b6f54dff4e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0be3da0a-22bd-4635-8859-b6f54dff4e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1270474826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc43d1e-d113-42e4-8030-352edb596660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fbe7ad1c9334e1e8536e7491e731420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:52Z,use_quota=True,user_id='e000ef6d98e94c138334b582096fdeee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83d9c10-8903-432f-953b-fc781db99ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b83d9c10-8903-432f-953b-fc781db99ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ee7b0d-4924-479b-8798-1b96bbcec597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ee7b0d-4924-479b-8798-1b96bbcec597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfc43d1e-d113-42e4-8030-352edb596660', 'volume_name': 'volume-cfc43d1e-d113-42e4-8030-352edb596660', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb99b58-3eb1-478b-b308-e9329e876e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edb99b58-3eb1-478b-b308-e9329e876e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd1af29-4094-490f-8f35-9b64efbdea63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:52 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Volume cfc43d1e-d113-42e4-8030-352edb596660: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfc43d1e-d113-42e4-8030-352edb596660', 'volume_size': 1} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1270474826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfc43d1e-d113-42e4-8030-352edb596660,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fbe7ad1c9334e1e8536e7491e731420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:52Z,use_quota=True,user_id='e000ef6d98e94c138334b582096fdeee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Creating volume cfc43d1e-d113-42e4-8030-352edb596660 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:46:52 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cfc43d1e-d113-42e4-8030-352edb596660 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:52 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cfc43d1e-d113-42e4-8030-352edb596660 1073741824 Sep 07 13:46:52 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_6t01x12zdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 13:46:52 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Image download 20.69 MB at 20.69 MB/s Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[960dfd2f-2420-4875-930c-3033e57c468d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_6t01x12zdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:53 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_6t01x12zdevstack@QuobyteHD Sep 07 13:46:53 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:53 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cfc43d1e-d113-42e4-8030-352edb596660 1073741824" returned: 0 in 0.777s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cfc43d1e-d113-42e4-8030-352edb596660 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:53 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cfc43d1e-d113-42e4-8030-352edb596660 Sep 07 13:46:53 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:53 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_6t01x12zdevstack@QuobyteHD" returned: 0 in 0.515s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:53 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Temporary image 09f2352e-bb3e-4924-9aca-b02c5284d704 is fetched for user 1896324a9d9e48139838cfbd2dbb9db8. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 13:46:53 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cfc43d1e-d113-42e4-8030-352edb596660" returned: 0 in 0.372s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:46:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4e2f30-83c2-46a7-94f4-8f9abc3310ad]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_6t01x12zdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cd1af29-4094-490f-8f35-9b64efbdea63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfc43d1e-d113-42e4-8030-352edb596660', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a068860-da1b-43ed-acca-084a34b2c47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:46:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Volume volume-cfc43d1e-d113-42e4-8030-352edb596660 (cfc43d1e-d113-42e4-8030-352edb596660): created successfully Sep 07 13:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a068860-da1b-43ed-acca-084a34b2c47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Flow 'volume_create_manager' (2badb408-79fe-4d51-991b-dc3e314eef4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:46:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-94734667-8984-4f22-b255-0d66026bf327 tempest-AttachVolumeTestJSON-959586247 None] Created volume successfully. Sep 07 13:46:53 devstack sudo[92756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_6t01x12zdevstack@QuobyteHD Sep 07 13:46:53 devstack sudo[92756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-6fb084e7-fb14-4a9d-9cc1-2d84565b987f req-73c71842-cde0-4860-899e-4e8db08bcebe tempest-ServerActionsTestOtherA-1927182931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-6fb084e7-fb14-4a9d-9cc1-2d84565b987f req-73c71842-cde0-4860-899e-4e8db08bcebe tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-6fb084e7-fb14-4a9d-9cc1-2d84565b987f req-73c71842-cde0-4860-899e-4e8db08bcebe tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:54 devstack sudo[92756]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_6t01x12zdevstack@QuobyteHD" returned: 0 in 0.622s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-153589046',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ef2ffa858d54483b8939110f0b60a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:46:51Z,use_quota=True,user_id='1896324a9d9e48139838cfbd2dbb9db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:46:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Creating volume c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:46:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:46:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:46:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:46:54 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:46:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-6fb084e7-fb14-4a9d-9cc1-2d84565b987f req-73c71842-cde0-4860-899e-4e8db08bcebe tempest-ServerActionsTestOtherA-1927182931 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-1672c1bf-f331-473f-9e7c-4646524d4215', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4c072ffd-0685-4a31-b41a-218268f84056', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:46:54 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 1073741824 Sep 07 13:46:54 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-6fb084e7-fb14-4a9d-9cc1-2d84565b987f req-73c71842-cde0-4860-899e-4e8db08bcebe tempest-ServerActionsTestOtherA-1927182931 None] attachment_update completed successfully. Sep 07 13:46:55 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 1073741824" returned: 0 in 0.849s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:55 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 Sep 07 13:46:55 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:55 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6" returned: 0 in 0.313s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:46:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.244s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-2b2ba944-d099-4cb6-b5d5-d07fb9ceaa48 req-45df7dd4-00d3-4ea6-b49e-7b065b71c9fb tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:46:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-2b2ba944-d099-4cb6-b5d5-d07fb9ceaa48 req-45df7dd4-00d3-4ea6-b49e-7b065b71c9fb tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:46:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-2b2ba944-d099-4cb6-b5d5-d07fb9ceaa48 req-45df7dd4-00d3-4ea6-b49e-7b065b71c9fb tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Attempting download of 09f2352e-bb3e-4924-9aca-b02c5284d704 ((None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}])) to volume c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 13:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-2b2ba944-d099-4cb6-b5d5-d07fb9ceaa48 req-45df7dd4-00d3-4ea6-b49e-7b065b71c9fb tempest-AttachVolumeTestJSON-959586247 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-cfc43d1e-d113-42e4-8030-352edb596660', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2adc9abd-4cb4-45ac-845c-ac646d131a01', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:46:55 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a634bbc-4527-4308-9fef-7141999b33fe]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_wkcj3e5t {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:55 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-2b2ba944-d099-4cb6-b5d5-d07fb9ceaa48 req-45df7dd4-00d3-4ea6-b49e-7b065b71c9fb tempest-AttachVolumeTestJSON-959586247 None] attachment_update completed successfully. Sep 07 13:46:55 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_wkcj3e5t Sep 07 13:46:55 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:56 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_wkcj3e5t" returned: 0 in 0.421s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_wkcj3e5t {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:56 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_wkcj3e5t Sep 07 13:46:56 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:56 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_wkcj3e5t" returned: 1 in 0.436s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_wkcj3e5t' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:46:56 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00020e2-4095-4490-ba55-b51ac697991b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:46:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_6t01x12zdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:56 devstack sudo[93182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_6t01x12zdevstack@QuobyteHD Sep 07 13:46:56 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:46:57 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root Sep 07 13:46:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_6t01x12zdevstack@QuobyteHD" returned: 0 in 0.598s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:46:57 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] 09f2352e-bb3e-4924-9aca-b02c5284d704 was qcow2, converting to qcow2 {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 13:46:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_6t01x12zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:46:57 devstack sudo[93195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_6t01x12zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 Sep 07 13:46:57 devstack sudo[93195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:00 devstack sudo[93195]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_6t01x12zdevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6" returned: 0 in 2.858s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:00 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_6t01x12zdevstack@QuobyteHD, size 112.00 MB, duration 2.86 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:47:00 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Converted 112.00 MB image at 39.18 MB/s Sep 07 13:47:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:00 devstack sudo[93267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 1G Sep 07 13:47:00 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:01 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 1G" returned: 0 in 1.195s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:01 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Downloaded image 09f2352e-bb3e-4924-9aca-b02c5284d704 ((None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}])) to volume c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 13:47:01 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Temporary image 09f2352e-bb3e-4924-9aca-b02c5284d704 for user 1896324a9d9e48139838cfbd2dbb9db8 is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 13:47:01 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Marking volume c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 13:47:01 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Copying metadata from image 09f2352e-bb3e-4924-9aca-b02c5284d704 to c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 13:47:01 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Creating volume glance metadata for volume c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 backed by image 09f2352e-bb3e-4924-9aca-b02c5284d704 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 13:47:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (571687a4-4603-4766-bc64-26efd492d0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6', 'volume_size': 1, 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e02e283d554267ad4387462fa3cb7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'created_at': datetime.datetime(2026, 9, 7, 11, 36, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09f2352e-bb3e-4924-9aca-b02c5284d704/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33f1796-f6eb-40a0-999d-eb379a44483f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:01 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Volume volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 (c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6): created successfully Sep 07 13:47:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33f1796-f6eb-40a0-999d-eb379a44483f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Flow 'volume_create_manager' (8902629b-c0f5-4f27-bf54-1ca3445b2f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-567fe6d1-5001-41b8-999f-dd52d1603661 tempest-VolumesExtendTest-635473949 None] Created volume successfully. Sep 07 13:47:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09189cfc-4020-4441-ae0e-741da30602d7 tempest-VolumesExtendTest-635473949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09189cfc-4020-4441-ae0e-741da30602d7 tempest-VolumesExtendTest-635473949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:02 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[27967d4a-0fed-4715-a0e2-183384178ffe]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09189cfc-4020-4441-ae0e-741da30602d7 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:03 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 Sep 07 13:47:03 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:03 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09189cfc-4020-4441-ae0e-741da30602d7 tempest-VolumesExtendTest-635473949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6" returned: 0 in 0.865s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09189cfc-4020-4441-ae0e-741da30602d7 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 2G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09189cfc-4020-4441-ae0e-741da30602d7 tempest-VolumesExtendTest-635473949 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 2G" returned: 0 in 0.246s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09189cfc-4020-4441-ae0e-741da30602d7 tempest-VolumesExtendTest-635473949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.204s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-09189cfc-4020-4441-ae0e-741da30602d7 tempest-VolumesExtendTest-635473949 None] Extend volume completed successfully. Sep 07 13:47:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Acquiring lock "cinder-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Lock "cinder-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:06 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=53,cinder:SELECT=88,cinder:INSERT=26,cinder:DELETE=4 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:47:06 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=62,cinder:INSERT=36,cinder:UPDATE=67,cinder:DELETE=6 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:47:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Acquiring lock "cinder-quobyte-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Lock "cinder-quobyte-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6" acquired by "delete_volume" :: waited 0.083s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d89a9af-53c7-454e-9e47-585aa7594818]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:07 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 Sep 07 13:47:07 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:07 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6" returned: 0 in 0.639s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:07 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6 Sep 07 13:47:07 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:08 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6" returned: 0 in 0.569s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Lock "cinder-quobyte-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6" released by "delete_volume" :: held 1.301s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Created reservations ['f6d7fa3d-7a91-4224-9e08-49ff837c4ad2', 'd36ac4d4-ed06-4409-b0e9-5b4c72ea194e', 'b2fbad39-f945-4a4a-bcdd-ead91d3d144c', 'af9b537c-8dd2-4fc9-a90f-d3604808c195'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:08 devstack sudo[93389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:47:08 devstack sudo[93389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:09 devstack sudo[93389]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.503s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:09 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Deleted volume successfully. Sep 07 13:47:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-81e210c7-70d5-46d3-a65b-440323506bd3 tempest-VolumesExtendTest-635473949 None] Lock "cinder-c884e93a-38d1-45f7-b1cb-5e1bdebdc9e6-delete_volume" released by "delete_volume" :: held 2.761s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Flow 'volume_create_manager' (6e81f22f-754f-470c-bf11-2cbf50df6431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2889a418-804d-4929-a944-1997e535c72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2889a418-804d-4929-a944-1997e535c72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-370477084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41db86f6-671e-4897-ba46-999eef8a6b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ef2ffa858d54483b8939110f0b60a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:10Z,use_quota=True,user_id='1896324a9d9e48139838cfbd2dbb9db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7671c0aa-8f73-4e37-b8c7-777c0ff835d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7671c0aa-8f73-4e37-b8c7-777c0ff835d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e289fce9-c926-49b6-b2e5-e6c7c1fab25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e289fce9-c926-49b6-b2e5-e6c7c1fab25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41db86f6-671e-4897-ba46-999eef8a6b16', 'volume_name': 'volume-41db86f6-671e-4897-ba46-999eef8a6b16', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d44a2d-efd6-4417-8f32-2d1d4d1d6099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6d44a2d-efd6-4417-8f32-2d1d4d1d6099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975121e2-0280-4d1b-9376-313418a1051e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:10 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Volume 41db86f6-671e-4897-ba46-999eef8a6b16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41db86f6-671e-4897-ba46-999eef8a6b16', 'volume_size': 1} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-370477084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41db86f6-671e-4897-ba46-999eef8a6b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ef2ffa858d54483b8939110f0b60a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:10Z,use_quota=True,user_id='1896324a9d9e48139838cfbd2dbb9db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Creating volume 41db86f6-671e-4897-ba46-999eef8a6b16 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:47:10 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:47:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:10 devstack sudo[93394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16 1073741824 Sep 07 13:47:10 devstack sudo[93394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:11 devstack sudo[93394]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16 1073741824" returned: 0 in 0.881s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:11 devstack sudo[93402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16 Sep 07 13:47:11 devstack sudo[93402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:11 devstack sudo[93402]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16" returned: 0 in 0.495s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:47:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.554s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (975121e2-0280-4d1b-9376-313418a1051e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41db86f6-671e-4897-ba46-999eef8a6b16', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14ca07e-3474-4417-b62f-ec0112176608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:12 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Volume volume-41db86f6-671e-4897-ba46-999eef8a6b16 (41db86f6-671e-4897-ba46-999eef8a6b16): created successfully Sep 07 13:47:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14ca07e-3474-4417-b62f-ec0112176608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Flow 'volume_create_manager' (6e81f22f-754f-470c-bf11-2cbf50df6431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-32e89970-5195-43c5-ac98-ba4d09988aed tempest-VolumesExtendTest-635473949 None] Created volume successfully. Sep 07 13:47:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] Creating offline snapshot 531d0479-4145-4376-81dc-c8595ec406eb of volume 41db86f6-671e-4897-ba46-999eef8a6b16 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:47:13 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa481c9-dd37-4553-8a02-851375da534a]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:13 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16 Sep 07 13:47:13 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:14 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16" returned: 0 in 1.034s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:14 devstack sudo[93414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb 1G Sep 07 13:47:14 devstack sudo[93414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:15 devstack sudo[93414]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb 1G" returned: 0 in 1.079s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41db86f6-671e-4897-ba46-999eef8a6b16 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:15 devstack sudo[93435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41db86f6-671e-4897-ba46-999eef8a6b16 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb Sep 07 13:47:15 devstack sudo[93435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:16 devstack sudo[93435]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41db86f6-671e-4897-ba46-999eef8a6b16 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb" returned: 0 in 1.097s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:16 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb is being set with open permissions: ugo+rw Sep 07 13:47:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:16 devstack sudo[93471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb Sep 07 13:47:16 devstack sudo[93471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:16 devstack sudo[93471]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb" returned: 0 in 0.429s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:16 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.info Sep 07 13:47:16 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:17 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.info" returned: 0 in 1.033s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:17 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.info is being set with open permissions: ugo+rw Sep 07 13:47:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:17 devstack sudo[93481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.info Sep 07 13:47:17 devstack sudo[93481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:18 devstack sudo[93481]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.info" returned: 0 in 0.569s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.471s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3ecd9a47-20be-46fb-8eeb-c37df5c2651e tempest-VolumesExtendTest-635473949 None] Create snapshot completed successfully Sep 07 13:47:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3a289dfe-9844-4c4b-b2a6-d80197aa6729 tempest-VolumesExtendTest-635473949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3a289dfe-9844-4c4b-b2a6-d80197aa6729 tempest-VolumesExtendTest-635473949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.004s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:20 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebc7939-fb52-41ed-921a-06dd9cba784e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a289dfe-9844-4c4b-b2a6-d80197aa6729 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:20 devstack sudo[93492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16 Sep 07 13:47:20 devstack sudo[93492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:20 devstack sudo[93492]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a289dfe-9844-4c4b-b2a6-d80197aa6729 tempest-VolumesExtendTest-635473949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16" returned: 0 in 0.688s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a289dfe-9844-4c4b-b2a6-d80197aa6729 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb 2G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a289dfe-9844-4c4b-b2a6-d80197aa6729 tempest-VolumesExtendTest-635473949 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb 2G" returned: 0 in 0.334s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3a289dfe-9844-4c4b-b2a6-d80197aa6729 tempest-VolumesExtendTest-635473949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.100s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3a289dfe-9844-4c4b-b2a6-d80197aa6729 tempest-VolumesExtendTest-635473949 None] Extend volume completed successfully. Sep 07 13:47:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Acquiring lock "cinder-531d0479-4145-4376-81dc-c8595ec406eb-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Lock "cinder-531d0479-4145-4376-81dc-c8595ec406eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Acquiring lock "cinder-quobyte-41db86f6-671e-4897-ba46-999eef8a6b16" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Lock "cinder-quobyte-41db86f6-671e-4897-ba46-999eef8a6b16" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Acquiring lock "cinder-quobyte-531d0479-4145-4376-81dc-c8595ec406eb" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Lock "cinder-quobyte-531d0479-4145-4376-81dc-c8595ec406eb" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Deleting offline snapshot 531d0479-4145-4376-81dc-c8595ec406eb of volume 41db86f6-671e-4897-ba46-999eef8a6b16 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:47:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] snapshot_file for this snap is: volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:47:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e958ddc8-4993-47f1-8209-1790e255b274]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:23 devstack sudo[93573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb Sep 07 13:47:23 devstack sudo[93573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:23 devstack sudo[93573]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb" returned: 0 in 0.610s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41db86f6-671e-4897-ba46-999eef8a6b16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:47:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6814de14-c806-4f37-b9ed-52c4dd455740]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:24 devstack sudo[93596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16 Sep 07 13:47:24 devstack sudo[93596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:24 devstack sudo[93596]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16" returned: 0 in 0.738s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:24 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb Sep 07 13:47:24 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:25 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb" returned: 0 in 0.836s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:25 devstack sudo[93613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb Sep 07 13:47:25 devstack sudo[93613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:25 devstack sudo[93613]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16.531d0479-4145-4376-81dc-c8595ec406eb" returned: 0 in 0.409s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Lock "cinder-quobyte-531d0479-4145-4376-81dc-c8595ec406eb" released by "_delete_snapshot" :: held 2.863s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Lock "cinder-quobyte-41db86f6-671e-4897-ba46-999eef8a6b16" released by "delete_snapshot" :: held 2.922s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:26 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Created reservations ['b29e1efc-8d37-473f-b270-a94810cfd43b', '12f9ad14-18b1-4f66-966d-0886f1f7f576', 'be255c37-4439-44d8-8b48-6a9ddb59b63d', '04ed2034-c300-4e1e-84c6-0681cd3d424a'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Delete snapshot completed successfully. Sep 07 13:47:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cb4d8a85-d917-403d-9aaf-ad6275fe9ec4 tempest-VolumesExtendTest-635473949 None] Lock "cinder-531d0479-4145-4376-81dc-c8595ec406eb-delete_snapshot" released by "delete_snapshot" :: held 3.249s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-4f559a9b-ddb1-4ae8-bfc2-e2f065c2fa5e req-0cbcee17-6868-42f3-b733-ede705c6ae15 tempest-ServerActionsTestOtherA-1927182931 None] Terminate volume connection completed successfully. Sep 07 13:47:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-4f559a9b-ddb1-4ae8-bfc2-e2f065c2fa5e req-0cbcee17-6868-42f3-b733-ede705c6ae15 tempest-ServerActionsTestOtherA-1927182931 None] Deleting attachment 4c072ffd-0685-4a31-b41a-218268f84056. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:47:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Acquiring lock "cinder-41db86f6-671e-4897-ba46-999eef8a6b16-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Lock "cinder-41db86f6-671e-4897-ba46-999eef8a6b16-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Acquiring lock "cinder-quobyte-41db86f6-671e-4897-ba46-999eef8a6b16" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Lock "cinder-quobyte-41db86f6-671e-4897-ba46-999eef8a6b16" acquired by "delete_volume" :: waited 0.033s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0abc156-fe6e-4adc-9195-23270aafb4df]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:27 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16 Sep 07 13:47:27 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:27 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16" returned: 0 in 0.779s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:27 devstack sudo[93645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16 Sep 07 13:47:27 devstack sudo[93645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:28 devstack sudo[93645]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-41db86f6-671e-4897-ba46-999eef8a6b16" returned: 0 in 0.454s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Lock "cinder-quobyte-41db86f6-671e-4897-ba46-999eef8a6b16" released by "delete_volume" :: held 1.382s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:28 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Created reservations ['cba37467-655e-4888-ae28-f5a23318622d', '8627ef5b-c5df-4a1b-8e27-baa8559f4632', '0a20e1ad-9a3a-4616-8671-eb01c743fb15', 'f66d4293-b981-4129-a401-99b8e23da951'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:28 devstack sudo[93651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:47:28 devstack sudo[93651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:28 devstack sudo[93651]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.361s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:28 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Deleted volume successfully. Sep 07 13:47:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-921a9a3b-7cd4-4f70-b8e8-ee6cd1895026 tempest-VolumesExtendTest-635473949 None] Lock "cinder-41db86f6-671e-4897-ba46-999eef8a6b16-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-4f559a9b-ddb1-4ae8-bfc2-e2f065c2fa5e req-047e2f35-0d98-4b57-be8a-999281ec6337 tempest-ServerActionsTestOtherA-1927182931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-4f559a9b-ddb1-4ae8-bfc2-e2f065c2fa5e req-047e2f35-0d98-4b57-be8a-999281ec6337 tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-4f559a9b-ddb1-4ae8-bfc2-e2f065c2fa5e req-047e2f35-0d98-4b57-be8a-999281ec6337 tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-4f559a9b-ddb1-4ae8-bfc2-e2f065c2fa5e req-047e2f35-0d98-4b57-be8a-999281ec6337 tempest-ServerActionsTestOtherA-1927182931 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-1672c1bf-f331-473f-9e7c-4646524d4215', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22fb15a2-165e-4a12-ba9d-b7f49452e4ce', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:47:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-4f559a9b-ddb1-4ae8-bfc2-e2f065c2fa5e req-047e2f35-0d98-4b57-be8a-999281ec6337 tempest-ServerActionsTestOtherA-1927182931 None] attachment_update completed successfully. Sep 07 13:47:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:47:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:29 devstack sudo[93677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:47:29 devstack sudo[93677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:30 devstack sudo[93677]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.601s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:47:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:47:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:47:38 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=31,cinder:INSERT=9,cinder:UPDATE=30,cinder:DELETE=4 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:47:39 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=28,cinder:INSERT=5,cinder:UPDATE=29 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:47:40 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:47:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Flow 'volume_create_manager' (2458e6ef-d0b2-485a-9c67-ce6415d68c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce0fffd-1c7f-4ba2-8d44-c71cc3a59932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce0fffd-1c7f-4ba2-8d44-c71cc3a59932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1861869119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635d9b92-1379-4ca0-9823-2c5e0a59498d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3f53b2512ab14f478161b640b1a671ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:41Z,use_quota=True,user_id='ca7225fa791a4f9ba3397a0789c02d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b75991-19a6-473f-aece-4e548f759b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b75991-19a6-473f-aece-4e548f759b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a63762-7ea0-4218-9f9b-56b65e7d82b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90a63762-7ea0-4218-9f9b-56b65e7d82b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '635d9b92-1379-4ca0-9823-2c5e0a59498d', 'volume_name': 'volume-635d9b92-1379-4ca0-9823-2c5e0a59498d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d978b77-2b0f-4f05-84fc-3a79e7d9e5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d978b77-2b0f-4f05-84fc-3a79e7d9e5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cf1fc7-67e8-43fe-b56e-e5cea8e0f53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:41 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Volume 635d9b92-1379-4ca0-9823-2c5e0a59498d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-635d9b92-1379-4ca0-9823-2c5e0a59498d', 'volume_size': 1} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1861869119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=635d9b92-1379-4ca0-9823-2c5e0a59498d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3f53b2512ab14f478161b640b1a671ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:41Z,use_quota=True,user_id='ca7225fa791a4f9ba3397a0789c02d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Creating volume 635d9b92-1379-4ca0-9823-2c5e0a59498d {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:47:41 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-635d9b92-1379-4ca0-9823-2c5e0a59498d 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:41 devstack sudo[93843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-635d9b92-1379-4ca0-9823-2c5e0a59498d 1073741824 Sep 07 13:47:41 devstack sudo[93843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:41 devstack sudo[93843]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-635d9b92-1379-4ca0-9823-2c5e0a59498d 1073741824" returned: 0 in 0.793s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-635d9b92-1379-4ca0-9823-2c5e0a59498d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:42 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-635d9b92-1379-4ca0-9823-2c5e0a59498d Sep 07 13:47:42 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:42 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-635d9b92-1379-4ca0-9823-2c5e0a59498d" returned: 0 in 0.359s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:47:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3cf1fc7-67e8-43fe-b56e-e5cea8e0f53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-635d9b92-1379-4ca0-9823-2c5e0a59498d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3035b46-3a29-4c07-a3f3-a59a26ca1607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:42 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Volume volume-635d9b92-1379-4ca0-9823-2c5e0a59498d (635d9b92-1379-4ca0-9823-2c5e0a59498d): created successfully Sep 07 13:47:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3035b46-3a29-4c07-a3f3-a59a26ca1607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Flow 'volume_create_manager' (2458e6ef-d0b2-485a-9c67-ce6415d68c44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-908b07e1-b915-43f6-8903-96f13e0fa4da tempest-VolumesGetTest-1266828159 None] Created volume successfully. Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Flow 'volume_create_manager' (50e65cd5-659c-4272-a3c2-2ee6c14506e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17090e6e-4fc1-400d-98a9-01d98cca1569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17090e6e-4fc1-400d-98a9-01d98cca1569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1180596720',display_name='tempest-VolumesGetTest-Volume-848693151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a154ad41-49bd-42e0-915f-6f8a759d43b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53b2512ab14f478161b640b1a671ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:44Z,use_quota=True,user_id='ca7225fa791a4f9ba3397a0789c02d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07481ae1-7d7e-474c-81fa-4fa1c2e0b984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07481ae1-7d7e-474c-81fa-4fa1c2e0b984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c3c23b-e143-4fe7-ac18-4cdb8a912d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50c3c23b-e143-4fe7-ac18-4cdb8a912d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a154ad41-49bd-42e0-915f-6f8a759d43b2', 'volume_name': 'volume-a154ad41-49bd-42e0-915f-6f8a759d43b2', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dca4f8b-8fd9-4e74-9bdd-d9d62fa73db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dca4f8b-8fd9-4e74-9bdd-d9d62fa73db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9efbac7-0812-45b3-8523-3d9ddf9e8ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Volume a154ad41-49bd-42e0-915f-6f8a759d43b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a154ad41-49bd-42e0-915f-6f8a759d43b2', 'volume_size': 1} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:44Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1180596720',display_name='tempest-VolumesGetTest-Volume-848693151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a154ad41-49bd-42e0-915f-6f8a759d43b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53b2512ab14f478161b640b1a671ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:44Z,use_quota=True,user_id='ca7225fa791a4f9ba3397a0789c02d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Creating volume a154ad41-49bd-42e0-915f-6f8a759d43b2 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:47:44 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a154ad41-49bd-42e0-915f-6f8a759d43b2 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:44 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a154ad41-49bd-42e0-915f-6f8a759d43b2 1073741824 Sep 07 13:47:44 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:44 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a154ad41-49bd-42e0-915f-6f8a759d43b2 1073741824" returned: 0 in 0.451s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a154ad41-49bd-42e0-915f-6f8a759d43b2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:44 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a154ad41-49bd-42e0-915f-6f8a759d43b2 Sep 07 13:47:44 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:44 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a154ad41-49bd-42e0-915f-6f8a759d43b2" returned: 0 in 0.277s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9efbac7-0812-45b3-8523-3d9ddf9e8ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a154ad41-49bd-42e0-915f-6f8a759d43b2', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185c948b-5ead-4381-9f4b-335c31ac0885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Volume volume-a154ad41-49bd-42e0-915f-6f8a759d43b2 (a154ad41-49bd-42e0-915f-6f8a759d43b2): created successfully Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (185c948b-5ead-4381-9f4b-335c31ac0885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Flow 'volume_create_manager' (50e65cd5-659c-4272-a3c2-2ee6c14506e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-357bd218-717d-49c9-acb9-4c3372e17d44 tempest-VolumesGetTest-1266828159 None] Created volume successfully. Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Flow 'volume_create_manager' (cfbbb0ab-5726-4273-bae8-accc317f614a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42a26db-1327-4cb9-8a1a-5a2c06379f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42a26db-1327-4cb9-8a1a-5a2c06379f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1212000684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a16345-802d-45a4-ac65-d6c6e59cf121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79fb0b09ef5f4b1fb06807858246c93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:45Z,use_quota=True,user_id='20ea159954eb424999fc516d90958973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30728b20-8f0f-4c81-8570-d76cc9464887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30728b20-8f0f-4c81-8570-d76cc9464887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b68b55a-4ea5-484b-9d0f-ba342acb2f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b68b55a-4ea5-484b-9d0f-ba342acb2f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a16345-802d-45a4-ac65-d6c6e59cf121', 'volume_name': 'volume-89a16345-802d-45a4-ac65-d6c6e59cf121', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f3b47a-6d1d-41b3-8e65-909553a69ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4f3b47a-6d1d-41b3-8e65-909553a69ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e187099-4c2a-43cb-ab9c-17a36e0866f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:45 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Volume 89a16345-802d-45a4-ac65-d6c6e59cf121: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a16345-802d-45a4-ac65-d6c6e59cf121', 'volume_size': 1} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1212000684',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a16345-802d-45a4-ac65-d6c6e59cf121,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79fb0b09ef5f4b1fb06807858246c93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:45Z,use_quota=True,user_id='20ea159954eb424999fc516d90958973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Creating volume 89a16345-802d-45a4-ac65-d6c6e59cf121 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:47:45 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:47:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a16345-802d-45a4-ac65-d6c6e59cf121 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:45 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a16345-802d-45a4-ac65-d6c6e59cf121 1073741824 Sep 07 13:47:45 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:46 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a16345-802d-45a4-ac65-d6c6e59cf121 1073741824" returned: 0 in 0.623s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a16345-802d-45a4-ac65-d6c6e59cf121 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:46 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a16345-802d-45a4-ac65-d6c6e59cf121 Sep 07 13:47:46 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Acquiring lock "cinder-a154ad41-49bd-42e0-915f-6f8a759d43b2-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Lock "cinder-a154ad41-49bd-42e0-915f-6f8a759d43b2-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:46 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-d6cfa0a3-c4ab-4bca-98b3-516427f6aaa7 req-5a682882-bb15-4fad-b127-8762e88c7414 tempest-AttachVolumeTestJSON-959586247 None] Terminate volume connection completed successfully. Sep 07 13:47:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-d6cfa0a3-c4ab-4bca-98b3-516427f6aaa7 req-5a682882-bb15-4fad-b127-8762e88c7414 tempest-AttachVolumeTestJSON-959586247 None] Deleting attachment 2adc9abd-4cb4-45ac-845c-ac646d131a01. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:47:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Acquiring lock "cinder-quobyte-a154ad41-49bd-42e0-915f-6f8a759d43b2" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-a154ad41-49bd-42e0-915f-6f8a759d43b2" acquired by "delete_volume" :: waited 0.042s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba47ecf-2b69-4648-9227-2e4477e9596c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a154ad41-49bd-42e0-915f-6f8a759d43b2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:46 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a16345-802d-45a4-ac65-d6c6e59cf121" returned: 0 in 0.489s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:47:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e187099-4c2a-43cb-ab9c-17a36e0866f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a16345-802d-45a4-ac65-d6c6e59cf121', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add7c700-22f0-4b25-a623-6986e3f979e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:46 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Volume volume-89a16345-802d-45a4-ac65-d6c6e59cf121 (89a16345-802d-45a4-ac65-d6c6e59cf121): created successfully Sep 07 13:47:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (add7c700-22f0-4b25-a623-6986e3f979e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Flow 'volume_create_manager' (cfbbb0ab-5726-4273-bae8-accc317f614a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:46 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6fc4288c-ac92-4a97-8722-45086ba24842 tempest-ServersNegativeTestJSON-806612355 None] Created volume successfully. Sep 07 13:47:46 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a154ad41-49bd-42e0-915f-6f8a759d43b2 Sep 07 13:47:46 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:47 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a154ad41-49bd-42e0-915f-6f8a759d43b2" returned: 0 in 0.592s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a154ad41-49bd-42e0-915f-6f8a759d43b2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:47 devstack sudo[93911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a154ad41-49bd-42e0-915f-6f8a759d43b2 Sep 07 13:47:47 devstack sudo[93911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:47 devstack sudo[93911]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a154ad41-49bd-42e0-915f-6f8a759d43b2" returned: 0 in 0.458s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-a154ad41-49bd-42e0-915f-6f8a759d43b2" released by "delete_volume" :: held 1.157s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:47 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Created reservations ['a6d97661-18ab-4207-a18b-c4cc1d54fe94', '4b20a58b-c5fe-4dfd-aba9-16ad0982daaa', 'd7517511-32ec-4f4a-bf17-62be6d27e235', 'ea97d84e-8eac-4fa0-bbfe-b3f5f6d34e83'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:48 devstack sudo[93919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:47:48 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:48 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.281s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:48 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:48 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Deleted volume successfully. Sep 07 13:47:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-115904ca-b00a-41c2-8bb0-1640c868106a tempest-VolumesGetTest-1266828159 None] Lock "cinder-a154ad41-49bd-42e0-915f-6f8a759d43b2-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Acquiring lock "cinder-635d9b92-1379-4ca0-9823-2c5e0a59498d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Lock "cinder-635d9b92-1379-4ca0-9823-2c5e0a59498d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Acquiring lock "cinder-quobyte-635d9b92-1379-4ca0-9823-2c5e0a59498d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-635d9b92-1379-4ca0-9823-2c5e0a59498d" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[85037753-f183-455d-8d8b-68c264bd4336]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-635d9b92-1379-4ca0-9823-2c5e0a59498d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:49 devstack sudo[93923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-635d9b92-1379-4ca0-9823-2c5e0a59498d Sep 07 13:47:49 devstack sudo[93923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:47:49 devstack sudo[93923]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Flow 'volume_create_manager' (4cc6257d-11f5-4cca-9909-95c8a84d7c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2575576f-04fc-47ce-aaca-589885a206c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-635d9b92-1379-4ca0-9823-2c5e0a59498d" returned: 0 in 0.735s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-635d9b92-1379-4ca0-9823-2c5e0a59498d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:49 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-635d9b92-1379-4ca0-9823-2c5e0a59498d Sep 07 13:47:49 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2575576f-04fc-47ce-aaca-589885a206c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1821604266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5592070-b2b2-4419-9fc7-9682635fb49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79fb0b09ef5f4b1fb06807858246c93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:50Z,use_quota=True,user_id='20ea159954eb424999fc516d90958973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f03eafa-b783-4727-b619-5d076231f220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f03eafa-b783-4727-b619-5d076231f220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b427eb-b19a-4cc8-adf2-559522d9e08f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86b427eb-b19a-4cc8-adf2-559522d9e08f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5592070-b2b2-4419-9fc7-9682635fb49b', 'volume_name': 'volume-d5592070-b2b2-4419-9fc7-9682635fb49b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88efd594-d3dc-4747-8aad-798374d79c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88efd594-d3dc-4747-8aad-798374d79c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56a651a-fa45-4d35-ae6b-2d2b47552cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:49 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Volume d5592070-b2b2-4419-9fc7-9682635fb49b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5592070-b2b2-4419-9fc7-9682635fb49b', 'volume_size': 1} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1821604266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5592070-b2b2-4419-9fc7-9682635fb49b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79fb0b09ef5f4b1fb06807858246c93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:50Z,use_quota=True,user_id='20ea159954eb424999fc516d90958973',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Creating volume d5592070-b2b2-4419-9fc7-9682635fb49b {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:47:49 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:47:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5592070-b2b2-4419-9fc7-9682635fb49b 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:49 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5592070-b2b2-4419-9fc7-9682635fb49b 1073741824 Sep 07 13:47:49 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:50 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-635d9b92-1379-4ca0-9823-2c5e0a59498d" returned: 0 in 0.286s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-635d9b92-1379-4ca0-9823-2c5e0a59498d" released by "delete_volume" :: held 1.078s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:50 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Created reservations ['ff6e534b-b052-4861-823e-bc0e16ee2ed2', '95a91185-e089-459e-981b-b59f1c406cb9', '366eae7d-d23f-4ead-91bc-7266784cea6f', '4d74a7eb-4751-467f-8de1-23ed9274f71b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:50 devstack sudo[93939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:47:50 devstack sudo[93939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:50 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5592070-b2b2-4419-9fc7-9682635fb49b 1073741824" returned: 0 in 0.779s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5592070-b2b2-4419-9fc7-9682635fb49b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:50 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5592070-b2b2-4419-9fc7-9682635fb49b Sep 07 13:47:50 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:50 devstack sudo[93939]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.615s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:50 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Deleted volume successfully. Sep 07 13:47:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8d73b6e-f816-4412-bea4-a05639981d7b tempest-VolumesGetTest-1266828159 None] Lock "cinder-635d9b92-1379-4ca0-9823-2c5e0a59498d-delete_volume" released by "delete_volume" :: held 2.078s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:51 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5592070-b2b2-4419-9fc7-9682635fb49b" returned: 0 in 0.494s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] <== create_volume: return (1362ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:47:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.365s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56a651a-fa45-4d35-ae6b-2d2b47552cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5592070-b2b2-4419-9fc7-9682635fb49b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6992b1c-e415-4af4-af72-0d98e33dc33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:51 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Volume volume-d5592070-b2b2-4419-9fc7-9682635fb49b (d5592070-b2b2-4419-9fc7-9682635fb49b): created successfully Sep 07 13:47:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6992b1c-e415-4af4-af72-0d98e33dc33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Flow 'volume_create_manager' (4cc6257d-11f5-4cca-9909-95c8a84d7c51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:51 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-713a31ab-371b-4927-b98f-ea8c39bad8ac tempest-ServersNegativeTestJSON-806612355 None] Created volume successfully. Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Flow 'volume_create_manager' (aed1b8d2-2195-4e6c-b084-ed17cd23e3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8cc46f-e018-46d3-b66f-c2585252d823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a8cc46f-e018-46d3-b66f-c2585252d823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1488514740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a5d26d-3c25-46ba-b3e8-cc0ca21ff616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53b2512ab14f478161b640b1a671ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:52Z,use_quota=True,user_id='ca7225fa791a4f9ba3397a0789c02d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539390ca-724e-43c5-9a0a-b8d19b700450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (539390ca-724e-43c5-9a0a-b8d19b700450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66ac57f-df28-425c-afd7-aaa6db7fd3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a66ac57f-df28-425c-afd7-aaa6db7fd3e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89a5d26d-3c25-46ba-b3e8-cc0ca21ff616', 'volume_name': 'volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0bce48-7364-4b5a-903e-fb787c968a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a0bce48-7364-4b5a-903e-fb787c968a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2607ccbd-2c3b-4bfb-8f5c-14c7036215c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:52 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Volume 89a5d26d-3c25-46ba-b3e8-cc0ca21ff616: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616', 'volume_size': 1} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1488514740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a5d26d-3c25-46ba-b3e8-cc0ca21ff616,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53b2512ab14f478161b640b1a671ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:52Z,use_quota=True,user_id='ca7225fa791a4f9ba3397a0789c02d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Creating volume 89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:47:52 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:47:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:52 devstack sudo[94025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 1073741824 Sep 07 13:47:52 devstack sudo[94025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Acquiring lock "cinder-d5592070-b2b2-4419-9fc7-9682635fb49b-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Lock "cinder-d5592070-b2b2-4419-9fc7-9682635fb49b-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Acquiring lock "cinder-quobyte-d5592070-b2b2-4419-9fc7-9682635fb49b" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Lock "cinder-quobyte-d5592070-b2b2-4419-9fc7-9682635fb49b" acquired by "delete_volume" :: waited 0.042s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a256bc4e-bbe8-4ad8-af56-117bdc553f1c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5592070-b2b2-4419-9fc7-9682635fb49b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:53 devstack sudo[94025]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 1073741824" returned: 0 in 1.099s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:53 devstack sudo[94045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5592070-b2b2-4419-9fc7-9682635fb49b Sep 07 13:47:53 devstack sudo[94045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:53 devstack sudo[94049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 Sep 07 13:47:53 devstack sudo[94049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:53 devstack sudo[94049]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616" returned: 0 in 0.347s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:47:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:54 devstack sudo[94045]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2607ccbd-2c3b-4bfb-8f5c-14c7036215c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f632cb12-90dd-46c4-bc1f-8d4da29ad190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5592070-b2b2-4419-9fc7-9682635fb49b" returned: 0 in 0.596s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5592070-b2b2-4419-9fc7-9682635fb49b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:54 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Volume volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 (89a5d26d-3c25-46ba-b3e8-cc0ca21ff616): created successfully Sep 07 13:47:54 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5592070-b2b2-4419-9fc7-9682635fb49b Sep 07 13:47:54 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f632cb12-90dd-46c4-bc1f-8d4da29ad190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Flow 'volume_create_manager' (aed1b8d2-2195-4e6c-b084-ed17cd23e3e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8eca20b3-07c7-4278-8756-429de72ae8d3 tempest-VolumesGetTest-1266828159 None] Created volume successfully. Sep 07 13:47:54 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5592070-b2b2-4419-9fc7-9682635fb49b" returned: 0 in 0.345s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Lock "cinder-quobyte-d5592070-b2b2-4419-9fc7-9682635fb49b" released by "delete_volume" :: held 1.024s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Created reservations ['de091b5a-00a3-461c-b571-97ae536db1b3', '43561317-baec-450e-bbc3-bbfb108bdab9', '361e4f7e-911a-4698-a9ca-5120414c15c7', '6a5a52f8-1bf6-41f3-9e7a-5dbbe0c3bb1b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:54 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:47:54 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:54 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.260s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Deleted volume successfully. Sep 07 13:47:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-82a73410-52e9-47a9-978b-0dbdad6166c7 tempest-ServersNegativeTestJSON-806612355 None] Lock "cinder-d5592070-b2b2-4419-9fc7-9682635fb49b-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Acquiring lock "cinder-89a16345-802d-45a4-ac65-d6c6e59cf121-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Lock "cinder-89a16345-802d-45a4-ac65-d6c6e59cf121-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Acquiring lock "cinder-quobyte-89a16345-802d-45a4-ac65-d6c6e59cf121" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Lock "cinder-quobyte-89a16345-802d-45a4-ac65-d6c6e59cf121" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:55 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[207fd909-c2e3-4ccf-9122-0f2a0e944e13]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a16345-802d-45a4-ac65-d6c6e59cf121 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:55 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a16345-802d-45a4-ac65-d6c6e59cf121 Sep 07 13:47:55 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:55 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:47:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Flow 'volume_create_manager' (cad534e7-35cb-4e81-9de7-9df4c3d8135a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:47:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d972d0da-68e7-4c2d-bfcf-be92fa5d477c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d972d0da-68e7-4c2d-bfcf-be92fa5d477c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:47:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-446411445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acd449a-3ee3-4387-abe7-801933e1c101,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3f53b2512ab14f478161b640b1a671ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:47:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=89a5d26d-3c25-46ba-b3e8-cc0ca21ff616,status='creating',terminated_at=None,updated_at=2026-09-07T11:47:56Z,use_quota=True,user_id='ca7225fa791a4f9ba3397a0789c02d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30cddd0-76a8-4487-b273-f4a86e78c283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f30cddd0-76a8-4487-b273-f4a86e78c283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb73b02-56ac-483c-a283-7a205ad0c42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb73b02-56ac-483c-a283-7a205ad0c42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6acd449a-3ee3-4387-abe7-801933e1c101', 'volume_name': 'volume-6acd449a-3ee3-4387-abe7-801933e1c101', 'volume_size': 1, 'source_volid': '89a5d26d-3c25-46ba-b3e8-cc0ca21ff616', 'source_volstatus': 'available'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2942609-a992-4edc-8f86-e0fceef61e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2942609-a992-4edc-8f86-e0fceef61e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3417d93c-d6ff-460a-bda5-785042ad8fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:47:56 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Volume 6acd449a-3ee3-4387-abe7-801933e1c101: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6acd449a-3ee3-4387-abe7-801933e1c101', 'volume_size': 1, 'source_volid': '89a5d26d-3c25-46ba-b3e8-cc0ca21ff616', 'source_volstatus': 'available'} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:56 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Cloning volume 89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 to volume 6acd449a-3ee3-4387-abe7-801933e1c101 Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Creating offline snapshot af42cd58-3ea4-40af-b927-366d9a2aa33e of volume 89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a381fb-42a5-4117-82dc-db48dbbf0466]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:56 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a16345-802d-45a4-ac65-d6c6e59cf121" returned: 0 in 0.460s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a16345-802d-45a4-ac65-d6c6e59cf121 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:56 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a16345-802d-45a4-ac65-d6c6e59cf121 Sep 07 13:47:56 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:56 devstack sudo[94071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 Sep 07 13:47:56 devstack sudo[94071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:56 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a16345-802d-45a4-ac65-d6c6e59cf121" returned: 0 in 0.281s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Lock "cinder-quobyte-89a16345-802d-45a4-ac65-d6c6e59cf121" released by "delete_volume" :: held 0.810s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:56 devstack sudo[94071]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Created reservations ['3d8703bd-88ca-4161-abf1-5d9305202969', 'f7bfc9b7-b692-4813-91f0-b16bb373ffad', 'fac424a7-616c-42a0-b52b-91ba98787769', 'cadccf75-2260-45e4-b0f6-208f05b8f49b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616" returned: 0 in 0.426s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:56 devstack sudo[94079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e 1G Sep 07 13:47:56 devstack sudo[94079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:56 devstack sudo[94081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:47:56 devstack sudo[94081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:56 devstack sudo[94081]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.318s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:57 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:47:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Deleted volume successfully. Sep 07 13:47:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-300ec83f-933b-49f1-b365-19646cb9541a tempest-ServersNegativeTestJSON-806612355 None] Lock "cinder-89a16345-802d-45a4-ac65-d6c6e59cf121-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:47:57 devstack sudo[94079]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e 1G" returned: 0 in 0.706s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:57 devstack sudo[94096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e Sep 07 13:47:57 devstack sudo[94096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:57 devstack sudo[94096]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e" returned: 0 in 0.575s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:57 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e is being set with open permissions: ugo+rw Sep 07 13:47:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:57 devstack sudo[94122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e Sep 07 13:47:57 devstack sudo[94122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:58 devstack sudo[94122]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e" returned: 0 in 0.431s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:58 devstack sudo[94127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.info Sep 07 13:47:58 devstack sudo[94127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:58 devstack sudo[94127]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.info" returned: 0 in 0.369s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:58 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.info is being set with open permissions: ugo+rw Sep 07 13:47:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:58 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.info Sep 07 13:47:58 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:59 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.info" returned: 0 in 0.382s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Acquiring lock "cinder-quobyte-6acd449a-3ee3-4387-abe7-801933e1c101" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:47:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-6acd449a-3ee3-4387-abe7-801933e1c101" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:47:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] snapshot: af42cd58-3ea4-40af-b927-366d9a2aa33e, volume: 6acd449a-3ee3-4387-abe7-801933e1c101, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:47:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:47:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:47:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:47:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:47:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:47:59 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e53ee3-5432-442e-9a3c-922e99b1b226]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:59 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e Sep 07 13:47:59 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:47:59 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Sep 07 13:47:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e" returned: 0 in 0.435s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:47:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:47:59 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[67850a77-cf4c-4f05-b4ee-2ea6df22fd6c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:47:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:47:59 devstack sudo[94139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 Sep 07 13:47:59 devstack sudo[94139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:00 devstack sudo[94139]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616" returned: 0 in 0.427s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] will copy from snapshot at /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:48:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:48:00 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Path /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6acd449a-3ee3-4387-abe7-801933e1c101 not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:48:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6acd449a-3ee3-4387-abe7-801933e1c101 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:00 devstack sudo[94144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6acd449a-3ee3-4387-abe7-801933e1c101 Sep 07 13:48:00 devstack sudo[94144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:08 devstack sudo[94144]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6acd449a-3ee3-4387-abe7-801933e1c101" returned: 0 in 7.950s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:08 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Image conversion details: src /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616, size 1024.00 MB, duration 7.95 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6acd449a-3ee3-4387-abe7-801933e1c101 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:48:08 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Converted 1024.00 MB image at 128.78 MB/s Sep 07 13:48:08 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6acd449a-3ee3-4387-abe7-801933e1c101 is being set with open permissions: ugo+rw Sep 07 13:48:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6acd449a-3ee3-4387-abe7-801933e1c101 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:08 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6acd449a-3ee3-4387-abe7-801933e1c101 Sep 07 13:48:08 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:08 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=47,cinder:SELECT=29,cinder:DELETE=4,cinder:INSERT=12 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:48:08 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=41,cinder:UPDATE=49,cinder:INSERT=11,cinder:DELETE=5 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:48:08 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6acd449a-3ee3-4387-abe7-801933e1c101" returned: 0 in 0.304s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-6acd449a-3ee3-4387-abe7-801933e1c101" released by "_copy_volume_from_snapshot" :: held 9.225s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Acquiring lock "cinder-quobyte-af42cd58-3ea4-40af-b927-366d9a2aa33e" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-af42cd58-3ea4-40af-b927-366d9a2aa33e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Deleting offline snapshot af42cd58-3ea4-40af-b927-366d9a2aa33e of volume 89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:48:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] snapshot_file for this snap is: volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:48:08 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3a9039-00b3-4feb-bd54-ebf6a3716a8e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:08 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e Sep 07 13:48:08 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:09 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e" returned: 0 in 0.565s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[700c513f-d0f2-496a-b53c-5f4836c973e9]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:09 devstack sudo[94223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 Sep 07 13:48:09 devstack sudo[94223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:09 devstack sudo[94223]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616" returned: 0 in 0.608s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:09 devstack sudo[94230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e Sep 07 13:48:09 devstack sudo[94230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-8db374db-90b4-430d-a0be-3e08e9e25f6f tempest-ServerActionsTestOtherA-1927182931 None] Terminate volume connection completed successfully. Sep 07 13:48:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-8db374db-90b4-430d-a0be-3e08e9e25f6f tempest-ServerActionsTestOtherA-1927182931 None] Deleting attachment 22fb15a2-165e-4a12-ba9d-b7f49452e4ce. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:48:10 devstack sudo[94230]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e" returned: 0 in 0.571s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:10 devstack sudo[94236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e Sep 07 13:48:10 devstack sudo[94236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Acquiring lock "cinder-1672c1bf-f331-473f-9e7c-4646524d4215-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Lock "cinder-1672c1bf-f331-473f-9e7c-4646524d4215-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Acquiring lock "cinder-quobyte-1672c1bf-f331-473f-9e7c-4646524d4215" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Lock "cinder-quobyte-1672c1bf-f331-473f-9e7c-4646524d4215" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:10 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad382b77-ed00-4aaf-8499-0c7f23f557e4]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:10 devstack sudo[94236]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616.af42cd58-3ea4-40af-b927-366d9a2aa33e" returned: 0 in 0.322s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-af42cd58-3ea4-40af-b927-366d9a2aa33e" released by "_delete_snapshot" :: held 2.203s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:10 devstack sudo[94238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215 Sep 07 13:48:10 devstack sudo[94238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.614s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3417d93c-d6ff-460a-bda5-785042ad8fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6acd449a-3ee3-4387-abe7-801933e1c101', 'volume_size': 1, 'source_volid': '89a5d26d-3c25-46ba-b3e8-cc0ca21ff616', 'source_volstatus': 'available'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34df2c34-1fd6-4a69-8855-c9393404e17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:10 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Volume volume-6acd449a-3ee3-4387-abe7-801933e1c101 (6acd449a-3ee3-4387-abe7-801933e1c101): created successfully Sep 07 13:48:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34df2c34-1fd6-4a69-8855-c9393404e17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Flow 'volume_create_manager' (cad534e7-35cb-4e81-9de7-9df4c3d8135a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7b44005a-e360-406d-81c3-3912ca381ed3 tempest-VolumesGetTest-1266828159 None] Created volume successfully. Sep 07 13:48:11 devstack sudo[94238]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215" returned: 0 in 0.551s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:11 devstack sudo[94244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215 Sep 07 13:48:11 devstack sudo[94244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Acquiring lock "cinder-8a1915e1-4dfd-4547-a1cb-17e1fa136b20-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Lock "cinder-8a1915e1-4dfd-4547-a1cb-17e1fa136b20-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Acquiring lock "cinder-quobyte-8a1915e1-4dfd-4547-a1cb-17e1fa136b20" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:11 devstack sudo[94244]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Lock "cinder-quobyte-8a1915e1-4dfd-4547-a1cb-17e1fa136b20" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1672c1bf-f331-473f-9e7c-4646524d4215" returned: 0 in 0.424s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Lock "cinder-quobyte-1672c1bf-f331-473f-9e7c-4646524d4215" released by "delete_volume" :: held 1.046s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[085a3f42-fe32-4815-86ae-d8d59efb40b9]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG cinder.quota [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Created reservations ['f12c23b5-0811-4d22-a553-cc7902057b42', 'aecf40d6-ee3f-4557-bc00-a95fb9750316', 'a54769bd-5b89-43c4-ab3f-a264d3f623bf', 'a246700d-4aa2-413e-8a5e-a6e824e1c9a7'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:11 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20 Sep 07 13:48:11 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:11 devstack sudo[94250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:48:11 devstack sudo[94250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:12 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20" returned: 0 in 0.544s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:12 devstack sudo[94250]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.352s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.manager [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:48:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Deleted volume successfully. Sep 07 13:48:12 devstack sudo[94256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20 Sep 07 13:48:12 devstack sudo[94256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-0023a93e-d089-49e0-93b1-2f2c87cc0f1c req-442e60a1-5c95-4e58-93b2-dcc3d953d4aa tempest-ServerActionsTestOtherA-1927182931 None] Lock "cinder-1672c1bf-f331-473f-9e7c-4646524d4215-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:12 devstack sudo[94256]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8a1915e1-4dfd-4547-a1cb-17e1fa136b20" returned: 0 in 0.278s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Lock "cinder-quobyte-8a1915e1-4dfd-4547-a1cb-17e1fa136b20" released by "delete_volume" :: held 0.882s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Created reservations ['0a76313e-74b0-461d-8e87-9d6d1c59662d', 'a5217816-215e-44e1-ab98-d187694c1ec5', 'fd99a3a4-f47f-404e-8e21-9ee915b26bbe', '9987b0cf-058d-4fa0-a9de-35ef2a5b7469'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Flow 'volume_create_manager' (e4bd864e-3868-4439-a81a-51e9521d934c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36285bc-f62a-4991-ae6f-0be06f8ea115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c36285bc-f62a-4991-ae6f-0be06f8ea115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1286193629',display_name='tempest-VolumesGetTest-Volume-2112974964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d237d01-b07d-47dc-9eb1-e66b515af315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53b2512ab14f478161b640b1a671ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:12Z,use_quota=True,user_id='ca7225fa791a4f9ba3397a0789c02d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5ce5d0-914f-4559-bf5d-ac2d29937ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5ce5d0-914f-4559-bf5d-ac2d29937ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d655920f-b6cd-472b-b9e8-0ffac142615e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d655920f-b6cd-472b-b9e8-0ffac142615e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d237d01-b07d-47dc-9eb1-e66b515af315', 'volume_name': 'volume-7d237d01-b07d-47dc-9eb1-e66b515af315', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a881151b-8336-4681-927d-67c638808c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a881151b-8336-4681-927d-67c638808c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cba6134-44e6-4c26-a014-f6e41c34eb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:12 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Volume 7d237d01-b07d-47dc-9eb1-e66b515af315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d237d01-b07d-47dc-9eb1-e66b515af315', 'volume_size': 1} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:12Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1286193629',display_name='tempest-VolumesGetTest-Volume-2112974964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d237d01-b07d-47dc-9eb1-e66b515af315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53b2512ab14f478161b640b1a671ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:12Z,use_quota=True,user_id='ca7225fa791a4f9ba3397a0789c02d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Creating volume 7d237d01-b07d-47dc-9eb1-e66b515af315 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:48:12 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d237d01-b07d-47dc-9eb1-e66b515af315 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:12 devstack sudo[94262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d237d01-b07d-47dc-9eb1-e66b515af315 1073741824 Sep 07 13:48:12 devstack sudo[94262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:12 devstack sudo[94264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:48:12 devstack sudo[94264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:12 devstack sudo[94264]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.318s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:48:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Deleted volume successfully. Sep 07 13:48:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12bb4dd4-f993-47cd-8887-568214e0d98b tempest-ServerActionsTestOtherA-1927182931 None] Lock "cinder-8a1915e1-4dfd-4547-a1cb-17e1fa136b20-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:13 devstack sudo[94262]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d237d01-b07d-47dc-9eb1-e66b515af315 1073741824" returned: 0 in 0.537s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d237d01-b07d-47dc-9eb1-e66b515af315 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:13 devstack sudo[94272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d237d01-b07d-47dc-9eb1-e66b515af315 Sep 07 13:48:13 devstack sudo[94272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:13 devstack sudo[94272]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d237d01-b07d-47dc-9eb1-e66b515af315" returned: 0 in 0.268s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:48:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cba6134-44e6-4c26-a014-f6e41c34eb98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d237d01-b07d-47dc-9eb1-e66b515af315', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9edecf-5fbe-451f-9c87-0426bc06a229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:13 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Volume volume-7d237d01-b07d-47dc-9eb1-e66b515af315 (7d237d01-b07d-47dc-9eb1-e66b515af315): created successfully Sep 07 13:48:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c9edecf-5fbe-451f-9c87-0426bc06a229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Flow 'volume_create_manager' (e4bd864e-3868-4439-a81a-51e9521d934c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:13 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cff84435-9a12-4222-9678-a3d0c179346d tempest-VolumesGetTest-1266828159 None] Created volume successfully. Sep 07 13:48:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Acquiring lock "cinder-7d237d01-b07d-47dc-9eb1-e66b515af315-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Lock "cinder-7d237d01-b07d-47dc-9eb1-e66b515af315-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Acquiring lock "cinder-quobyte-7d237d01-b07d-47dc-9eb1-e66b515af315" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-7d237d01-b07d-47dc-9eb1-e66b515af315" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:14 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[79dd5a71-ae34-44e5-941e-8d9124862c63]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d237d01-b07d-47dc-9eb1-e66b515af315 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:15 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d237d01-b07d-47dc-9eb1-e66b515af315 Sep 07 13:48:15 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:15 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d237d01-b07d-47dc-9eb1-e66b515af315" returned: 0 in 0.663s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d237d01-b07d-47dc-9eb1-e66b515af315 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:15 devstack sudo[94306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d237d01-b07d-47dc-9eb1-e66b515af315 Sep 07 13:48:15 devstack sudo[94306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:15 devstack sudo[94306]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d237d01-b07d-47dc-9eb1-e66b515af315" returned: 0 in 0.497s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-7d237d01-b07d-47dc-9eb1-e66b515af315" released by "delete_volume" :: held 1.238s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:16 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Created reservations ['c62302aa-e07a-4b74-bc27-49b71a89c987', '3ce8d083-7c1f-41cf-a1a6-c754590dc26b', '312116d6-57a6-493a-bf18-d1d69e4cbb2b', '9d1cafb6-5aa0-49b2-bf45-6f1012e4df4b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:16 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:48:16 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:16 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.268s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:16 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:48:16 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Deleted volume successfully. Sep 07 13:48:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-201b4bed-4466-440e-b835-61de6f8b7e5e tempest-VolumesGetTest-1266828159 None] Lock "cinder-7d237d01-b07d-47dc-9eb1-e66b515af315-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Acquiring lock "cinder-6acd449a-3ee3-4387-abe7-801933e1c101-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Lock "cinder-6acd449a-3ee3-4387-abe7-801933e1c101-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Acquiring lock "cinder-quobyte-6acd449a-3ee3-4387-abe7-801933e1c101" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-6acd449a-3ee3-4387-abe7-801933e1c101" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:17 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0ba76f-7383-48c4-b745-fda7fe75464b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6acd449a-3ee3-4387-abe7-801933e1c101 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:17 devstack sudo[94313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6acd449a-3ee3-4387-abe7-801933e1c101 Sep 07 13:48:17 devstack sudo[94313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:17 devstack sudo[94313]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6acd449a-3ee3-4387-abe7-801933e1c101" returned: 0 in 0.421s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6acd449a-3ee3-4387-abe7-801933e1c101 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:17 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6acd449a-3ee3-4387-abe7-801933e1c101 Sep 07 13:48:17 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:18 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6acd449a-3ee3-4387-abe7-801933e1c101" returned: 0 in 0.285s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-6acd449a-3ee3-4387-abe7-801933e1c101" released by "delete_volume" :: held 0.761s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Created reservations ['7c5e8d6a-b7f2-4c58-ad06-9d6ceb485e6e', '99f36623-af54-4090-9ab2-abe7509d7d61', 'ddbbc4b5-e9ca-4b80-9be9-2d4fad25a311', '96c12ea7-5c4a-45d3-b04e-576f50d38aa0'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:18 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:48:18 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Acquiring lock "cinder-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Lock "cinder-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:18 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.317s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:48:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Deleted volume successfully. Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-74240b86-3113-41ed-a2d2-ebe7779f9fd5 tempest-VolumesGetTest-1266828159 None] Lock "cinder-6acd449a-3ee3-4387-abe7-801933e1c101-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Acquiring lock "cinder-quobyte-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f7ab81-b5bf-4022-a26e-d44042b94d61]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:18 devstack sudo[94324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 Sep 07 13:48:18 devstack sudo[94324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:19 devstack sudo[94324]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616" returned: 0 in 0.491s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:19 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616 Sep 07 13:48:19 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:19 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616" returned: 0 in 0.292s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616" released by "delete_volume" :: held 0.857s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:19 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Created reservations ['8bbadea4-39b5-4130-9b9f-201f52beb1ae', 'ed4d6a10-2698-44ba-9601-92ff4d834b4a', 'db0966bc-cb22-45d7-9260-679045e381a8', '8c9c0142-dddb-47b7-9b4b-c9ba4ea5c88f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:19 devstack sudo[94332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:48:19 devstack sudo[94332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:19 devstack sudo[94332]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.321s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:19 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:48:19 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Deleted volume successfully. Sep 07 13:48:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b6c2bc5f-9b8b-48c5-bd82-c3f3816618f2 tempest-VolumesGetTest-1266828159 None] Lock "cinder-89a5d26d-3c25-46ba-b3e8-cc0ca21ff616-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Flow 'volume_create_manager' (a1d3af0f-6b2f-43d3-82eb-811bc3cdefc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd57f2e-4cb1-488a-b891-863cd50a6734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd57f2e-4cb1-488a-b891-863cd50a6734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-211690215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b75a74f-8219-4e23-b6c7-54ce16a68dbb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3f53b2512ab14f478161b640b1a671ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:21Z,use_quota=True,user_id='ca7225fa791a4f9ba3397a0789c02d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (099800c3-25f5-429c-a40f-7bed29c5aa9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (099800c3-25f5-429c-a40f-7bed29c5aa9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c8ec01-fa01-4b91-be2a-ec19f25099ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:20 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 13:48:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00c8ec01-fa01-4b91-be2a-ec19f25099ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8b75a74f-8219-4e23-b6c7-54ce16a68dbb', 'volume_name': 'volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb', 'volume_size': 1, 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e02e283d554267ad4387462fa3cb7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'created_at': datetime.datetime(2026, 9, 7, 11, 36, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09f2352e-bb3e-4924-9aca-b02c5284d704/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d655813-ba52-42ef-baba-c8abf9324d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d655813-ba52-42ef-baba-c8abf9324d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa3d9e2-fa09-4e2d-9a75-eb796e6b8d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:21 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Volume 8b75a74f-8219-4e23-b6c7-54ce16a68dbb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb', 'volume_size': 1, 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e02e283d554267ad4387462fa3cb7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'created_at': datetime.datetime(2026, 9, 7, 11, 36, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09f2352e-bb3e-4924-9aca-b02c5284d704/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 13:48:21 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Trying to clone 8b75a74f-8219-4e23-b6c7-54ce16a68dbb from image 09f2352e-bb3e-4924-9aca-b02c5284d704 at location (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 13:48:21 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_4jt4sqvrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 13:48:21 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Image download 20.69 MB at 20.69 MB/s Sep 07 13:48:21 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3f26e6-c3dc-425d-a49d-98d04937f8ad]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_4jt4sqvrdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:21 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_4jt4sqvrdevstack@QuobyteHD Sep 07 13:48:21 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:22 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_4jt4sqvrdevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:22 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Temporary image 09f2352e-bb3e-4924-9aca-b02c5284d704 is fetched for user ca7225fa791a4f9ba3397a0789c02d80. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 13:48:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f703c91d-3af7-4fcb-9e16-6f061b1f7f89]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_4jt4sqvrdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:22 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_4jt4sqvrdevstack@QuobyteHD Sep 07 13:48:22 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:22 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_4jt4sqvrdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-211690215',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b75a74f-8219-4e23-b6c7-54ce16a68dbb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3f53b2512ab14f478161b640b1a671ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:21Z,use_quota=True,user_id='ca7225fa791a4f9ba3397a0789c02d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:48:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Creating volume 8b75a74f-8219-4e23-b6c7-54ce16a68dbb {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:48:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:48:22 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:48:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:22 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb 1073741824 Sep 07 13:48:22 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:23 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb 1073741824" returned: 0 in 0.662s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:23 devstack sudo[94355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb Sep 07 13:48:23 devstack sudo[94355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:23 devstack sudo[94355]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb" returned: 0 in 0.316s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:48:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:23 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Attempting download of 09f2352e-bb3e-4924-9aca-b02c5284d704 ((None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}])) to volume 8b75a74f-8219-4e23-b6c7-54ce16a68dbb. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 13:48:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a62ff5-d29a-47e7-93a7-67b4926220d6]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_ngaavq9u {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:23 devstack sudo[94358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_ngaavq9u Sep 07 13:48:23 devstack sudo[94358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:24 devstack sudo[94358]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_ngaavq9u" returned: 0 in 0.482s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_ngaavq9u {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:24 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_ngaavq9u Sep 07 13:48:24 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:24 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_ngaavq9u" returned: 1 in 0.384s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704_ngaavq9u' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:48:24 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81f5f75-1eb8-4729-8873-699a93583379]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_4jt4sqvrdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:24 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_4jt4sqvrdevstack@QuobyteHD Sep 07 13:48:24 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:25 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_4jt4sqvrdevstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:25 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] 09f2352e-bb3e-4924-9aca-b02c5284d704 was qcow2, converting to qcow2 {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 13:48:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_4jt4sqvrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:25 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_4jt4sqvrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb Sep 07 13:48:25 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:27 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_4jt4sqvrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb" returned: 0 in 2.313s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:27 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_4jt4sqvrdevstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:48:27 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Converted 112.00 MB image at 48.38 MB/s Sep 07 13:48:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:27 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb 1G Sep 07 13:48:27 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:27 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb 1G" returned: 0 in 0.460s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Downloaded image 09f2352e-bb3e-4924-9aca-b02c5284d704 ((None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}])) to volume 8b75a74f-8219-4e23-b6c7-54ce16a68dbb successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 13:48:27 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Temporary image 09f2352e-bb3e-4924-9aca-b02c5284d704 for user ca7225fa791a4f9ba3397a0789c02d80 is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 13:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Marking volume 8b75a74f-8219-4e23-b6c7-54ce16a68dbb as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 13:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Copying metadata from image 09f2352e-bb3e-4924-9aca-b02c5284d704 to 8b75a74f-8219-4e23-b6c7-54ce16a68dbb. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 13:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Creating volume glance metadata for volume 8b75a74f-8219-4e23-b6c7-54ce16a68dbb backed by image 09f2352e-bb3e-4924-9aca-b02c5284d704 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 13:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afa3d9e2-fa09-4e2d-9a75-eb796e6b8d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb', 'volume_size': 1, 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e02e283d554267ad4387462fa3cb7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'created_at': datetime.datetime(2026, 9, 7, 11, 36, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09f2352e-bb3e-4924-9aca-b02c5284d704/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e43a4b-d2cd-4323-b19c-b0d5191e4ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:27 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Volume volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb (8b75a74f-8219-4e23-b6c7-54ce16a68dbb): created successfully Sep 07 13:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e43a4b-d2cd-4323-b19c-b0d5191e4ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Flow 'volume_create_manager' (a1d3af0f-6b2f-43d3-82eb-811bc3cdefc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d089384d-30fc-4690-ab35-56a8b75d4a99 tempest-VolumesGetTest-1266828159 None] Created volume successfully. Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Flow 'volume_create_manager' (f05a90e2-8e4c-49ca-a2e9-b7081097184c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c96109-e97c-453a-8e28-4eae3bd96a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c96109-e97c-453a-8e28-4eae3bd96a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-933949013',display_name='tempest-VolumesGetTest-Volume-198137128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576102d5-6516-4d4b-8b1f-94565d59d62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53b2512ab14f478161b640b1a671ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:29Z,use_quota=True,user_id='ca7225fa791a4f9ba3397a0789c02d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7926d9d-50fa-4edf-bd4a-a7d30b9c2b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7926d9d-50fa-4edf-bd4a-a7d30b9c2b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9d7830-051c-44f2-bd4e-4128d5535021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b9d7830-051c-44f2-bd4e-4128d5535021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576102d5-6516-4d4b-8b1f-94565d59d62e', 'volume_name': 'volume-576102d5-6516-4d4b-8b1f-94565d59d62e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f7e4dc-bba4-4bba-80d5-733cb4b751a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8f7e4dc-bba4-4bba-80d5-733cb4b751a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ffab1b-2b24-4b90-b237-3f4c6d9d25b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:29 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Volume 576102d5-6516-4d4b-8b1f-94565d59d62e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576102d5-6516-4d4b-8b1f-94565d59d62e', 'volume_size': 1} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:29Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-933949013',display_name='tempest-VolumesGetTest-Volume-198137128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576102d5-6516-4d4b-8b1f-94565d59d62e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f53b2512ab14f478161b640b1a671ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:29Z,use_quota=True,user_id='ca7225fa791a4f9ba3397a0789c02d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Creating volume 576102d5-6516-4d4b-8b1f-94565d59d62e {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:48:29 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-576102d5-6516-4d4b-8b1f-94565d59d62e 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:29 devstack sudo[94390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-576102d5-6516-4d4b-8b1f-94565d59d62e 1073741824 Sep 07 13:48:29 devstack sudo[94390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-024876ff-66ac-4dc0-8803-eeab51f97fa4 tempest-GroupSnapshotsTest-1713684335 None] Group tempest-GroupSnapshotsTest-Group-1806166845: creating Sep 07 13:48:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-024876ff-66ac-4dc0-8803-eeab51f97fa4 tempest-GroupSnapshotsTest-1713684335 None] Group tempest-GroupSnapshotsTest-Group-1806166845: created successfully Sep 07 13:48:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-024876ff-66ac-4dc0-8803-eeab51f97fa4 tempest-GroupSnapshotsTest-1713684335 None] Create group completed successfully. Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:29 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:48:29 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:29 devstack sudo[94390]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-576102d5-6516-4d4b-8b1f-94565d59d62e 1073741824" returned: 0 in 0.574s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-576102d5-6516-4d4b-8b1f-94565d59d62e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:29 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-576102d5-6516-4d4b-8b1f-94565d59d62e Sep 07 13:48:29 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:30 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.315s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:48:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:48:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:48:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:48:30 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-576102d5-6516-4d4b-8b1f-94565d59d62e" returned: 0 in 0.290s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:48:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78ffab1b-2b24-4b90-b237-3f4c6d9d25b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576102d5-6516-4d4b-8b1f-94565d59d62e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215347e4-f5cd-4a63-a288-14d73b48c3ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:30 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Volume volume-576102d5-6516-4d4b-8b1f-94565d59d62e (576102d5-6516-4d4b-8b1f-94565d59d62e): created successfully Sep 07 13:48:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215347e4-f5cd-4a63-a288-14d73b48c3ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Flow 'volume_create_manager' (f05a90e2-8e4c-49ca-a2e9-b7081097184c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:30 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-806489a6-ace4-495e-ad86-a2440b975559 tempest-VolumesGetTest-1266828159 None] Created volume successfully. Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Flow 'volume_create_manager' (f13440d6-949a-4544-b004-a0cecf2bad7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b35040-147b-473f-9f0b-8beba7035fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2b35040-147b-473f-9f0b-8beba7035fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1340977768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5fc0af3c-2a5d-4a14-b6dc-d45f94e64ff2,host='devstack@QuobyteHD#QuobyteHD',id=0e80fc06-d3d2-4d90-9378-164f6b98fbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c21ee7999f04f48a341bbc7b7f07c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:32Z,use_quota=True,user_id='d7af12c7402942118e3379237a151512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bda37df8-05c0-470f-90d3-c9dbee545a38),volume_type_id=bda37df8-05c0-470f-90d3-c9dbee545a38)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87650e71-5189-488c-8dd0-68f097da29c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87650e71-5189-488c-8dd0-68f097da29c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18ffcab-06d4-436c-96c4-2b0229636f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b18ffcab-06d4-436c-96c4-2b0229636f50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e80fc06-d3d2-4d90-9378-164f6b98fbb9', 'volume_name': 'volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d338310-fd85-4d53-a2ee-cc07695f2a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d338310-fd85-4d53-a2ee-cc07695f2a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c9d462-a0cf-420a-b76f-3160918fc3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:31 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Volume 0e80fc06-d3d2-4d90-9378-164f6b98fbb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9', 'volume_size': 1} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5fc0af3c-2a5d-4a14-b6dc-d45f94e64ff2,created_at=2026-09-07T11:48:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1340977768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5fc0af3c-2a5d-4a14-b6dc-d45f94e64ff2,host='devstack@QuobyteHD#QuobyteHD',id=0e80fc06-d3d2-4d90-9378-164f6b98fbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c21ee7999f04f48a341bbc7b7f07c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:32Z,use_quota=True,user_id='d7af12c7402942118e3379237a151512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bda37df8-05c0-470f-90d3-c9dbee545a38),volume_type_id=bda37df8-05c0-470f-90d3-c9dbee545a38)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Creating volume 0e80fc06-d3d2-4d90-9378-164f6b98fbb9 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:48:31 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Acquiring lock "cinder-576102d5-6516-4d4b-8b1f-94565d59d62e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:31 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 1073741824 Sep 07 13:48:31 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Lock "cinder-576102d5-6516-4d4b-8b1f-94565d59d62e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Acquiring lock "cinder-quobyte-576102d5-6516-4d4b-8b1f-94565d59d62e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-576102d5-6516-4d4b-8b1f-94565d59d62e" acquired by "delete_volume" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:32 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[225c80ea-0f1e-46fd-ac32-3eeba295cf16]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-576102d5-6516-4d4b-8b1f-94565d59d62e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:32 devstack sudo[94428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-576102d5-6516-4d4b-8b1f-94565d59d62e Sep 07 13:48:32 devstack sudo[94428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:32 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 1073741824" returned: 0 in 0.624s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:32 devstack sudo[94428]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-576102d5-6516-4d4b-8b1f-94565d59d62e" returned: 0 in 0.513s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-576102d5-6516-4d4b-8b1f-94565d59d62e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:32 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 Sep 07 13:48:32 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:32 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-576102d5-6516-4d4b-8b1f-94565d59d62e Sep 07 13:48:32 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:32 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9" returned: 0 in 0.388s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:48:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8c9d462-a0cf-420a-b76f-3160918fc3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22be8c60-9ddd-491b-b29d-8963121e4369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:32 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Volume volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 (0e80fc06-d3d2-4d90-9378-164f6b98fbb9): created successfully Sep 07 13:48:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22be8c60-9ddd-491b-b29d-8963121e4369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:32 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Flow 'volume_create_manager' (f13440d6-949a-4544-b004-a0cecf2bad7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-576102d5-6516-4d4b-8b1f-94565d59d62e" returned: 0 in 0.485s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-576102d5-6516-4d4b-8b1f-94565d59d62e" released by "delete_volume" :: held 1.082s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-42331da8-3677-4647-9466-646d20be0c5f tempest-GroupSnapshotsTest-1713684335 None] Created volume successfully. Sep 07 13:48:33 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Created reservations ['27778191-57a6-4a89-ab0a-c0434cfb42f5', '5d71ad96-3cbc-4f36-8de8-07103f180d0f', '74fcb853-d2b1-4a52-96fd-8b898d807c5f', '96b5448e-418e-44f6-a1f6-6a6efd52428a'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:33 devstack sudo[94446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:48:33 devstack sudo[94446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:33 devstack sudo[94446]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.335s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:48:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Deleted volume successfully. Sep 07 13:48:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3d0d8bad-ff41-4aaf-8a39-2b646a681e14 tempest-VolumesGetTest-1266828159 None] Lock "cinder-576102d5-6516-4d4b-8b1f-94565d59d62e-delete_volume" released by "delete_volume" :: held 1.722s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Acquiring lock "cinder-8b75a74f-8219-4e23-b6c7-54ce16a68dbb-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Lock "cinder-8b75a74f-8219-4e23-b6c7-54ce16a68dbb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Acquiring lock "cinder-quobyte-8b75a74f-8219-4e23-b6c7-54ce16a68dbb" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-8b75a74f-8219-4e23-b6c7-54ce16a68dbb" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:34 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b240c289-2b0d-4d58-8465-0d4f124f7d06]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:34 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] GroupSnapshot 2f72b98e-093b-464a-928b-3c61615ce5cc: creating. Sep 07 13:48:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] Group snapshot 2f72b98e-093b-464a-928b-3c61615ce5cc: creating. {{(pid=87444) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 13:48:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:34 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb Sep 07 13:48:34 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] Creating offline snapshot c01a0595-0798-4dc3-bc6e-0e6b4c04951f of volume 0e80fc06-d3d2-4d90-9378-164f6b98fbb9 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:48:34 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7bf32a-8261-4f28-9ba4-1462d7fae896]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:34 devstack sudo[94456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 Sep 07 13:48:34 devstack sudo[94456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:34 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb" returned: 0 in 0.519s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:34 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb Sep 07 13:48:34 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:35 devstack sudo[94456]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9" returned: 0 in 0.561s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:35 devstack sudo[94466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f 1G Sep 07 13:48:35 devstack sudo[94466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:35 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8b75a74f-8219-4e23-b6c7-54ce16a68dbb" returned: 0 in 0.337s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Lock "cinder-quobyte-8b75a74f-8219-4e23-b6c7-54ce16a68dbb" released by "delete_volume" :: held 0.927s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:35 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Created reservations ['1d426a72-7eaf-4538-beba-5cfab4ed6108', '53dc9044-bebc-4a15-a4ce-bad9e2a41618', 'a208b210-530f-45ff-b5e0-ac6596ec39d2', 'f996b286-1f27-4097-b03f-5b0712cbe0cc'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:35 devstack sudo[94472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:48:35 devstack sudo[94472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:35 devstack sudo[94466]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f 1G" returned: 0 in 0.702s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:35 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f Sep 07 13:48:35 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:35 devstack sudo[94472]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.514s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:35 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:48:35 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Deleted volume successfully. Sep 07 13:48:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-58504873-c844-4201-8917-ebaa8534e706 tempest-VolumesGetTest-1266828159 None] Lock "cinder-8b75a74f-8219-4e23-b6c7-54ce16a68dbb-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:36 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f" returned: 0 in 0.434s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:36 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:48:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:36 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f Sep 07 13:48:36 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:36 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f" returned: 0 in 0.366s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:36 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.info Sep 07 13:48:36 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:37 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.info" returned: 0 in 0.679s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:37 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:48:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:37 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.info Sep 07 13:48:37 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:37 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.info" returned: 0 in 0.302s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.193s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-18b5c373-52ca-45e2-8ab7-9a0b379b6aa6 tempest-GroupSnapshotsTest-1713684335 None] group_snapshot 2f72b98e-093b-464a-928b-3c61615ce5cc: created successfully Sep 07 13:48:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "cinder-quobyte-c01a0595-0798-4dc3-bc6e-0e6b4c04951f-483de6a1-8591-4c0c-8606-8ddae5f438d8" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-c01a0595-0798-4dc3-bc6e-0e6b4c04951f-483de6a1-8591-4c0c-8606-8ddae5f438d8" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Creating volume 483de6a1-8591-4c0c-8606-8ddae5f438d8 from snapshot c01a0595-0798-4dc3-bc6e-0e6b4c04951f {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 13:48:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:48:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "cinder-quobyte-483de6a1-8591-4c0c-8606-8ddae5f438d8" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-483de6a1-8591-4c0c-8606-8ddae5f438d8" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] snapshot: c01a0595-0798-4dc3-bc6e-0e6b4c04951f, volume: 483de6a1-8591-4c0c-8606-8ddae5f438d8, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:48:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d18ab7-2e3b-47d6-a207-17f3ccf8b800]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:40 devstack sudo[94583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f Sep 07 13:48:40 devstack sudo[94583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:41 devstack sudo[94583]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f" returned: 0 in 0.914s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:41 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[29107fb6-ef7e-45dd-b638-ad8e6523c8a9]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:41 devstack sudo[94617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 Sep 07 13:48:41 devstack sudo[94617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:41 devstack sudo[94617]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9" returned: 0 in 0.761s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] will copy from snapshot at /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:48:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:48:41 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Path /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-483de6a1-8591-4c0c-8606-8ddae5f438d8 not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:48:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-483de6a1-8591-4c0c-8606-8ddae5f438d8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:41 devstack sudo[94625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-483de6a1-8591-4c0c-8606-8ddae5f438d8 Sep 07 13:48:41 devstack sudo[94625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:49 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=61,cinder:UPDATE=73,cinder:DELETE=7,cinder:INSERT=24 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:48:50 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=79,cinder:SELECT=64,cinder:INSERT=23,cinder:DELETE=5 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:48:50 devstack sudo[94625]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-483de6a1-8591-4c0c-8606-8ddae5f438d8" returned: 0 in 8.527s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:50 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Image conversion details: src /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9, size 1024.00 MB, duration 8.53 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-483de6a1-8591-4c0c-8606-8ddae5f438d8 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:48:50 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Converted 1024.00 MB image at 120.01 MB/s Sep 07 13:48:50 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-483de6a1-8591-4c0c-8606-8ddae5f438d8 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:48:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-483de6a1-8591-4c0c-8606-8ddae5f438d8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:50 devstack sudo[94663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-483de6a1-8591-4c0c-8606-8ddae5f438d8 Sep 07 13:48:50 devstack sudo[94663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:50 devstack sudo[94663]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-483de6a1-8591-4c0c-8606-8ddae5f438d8" returned: 0 in 0.499s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-483de6a1-8591-4c0c-8606-8ddae5f438d8" released by "_copy_volume_from_snapshot" :: held 10.926s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-c01a0595-0798-4dc3-bc6e-0e6b4c04951f-483de6a1-8591-4c0c-8606-8ddae5f438d8" released by "_create_volume_from_snapshot" :: held 11.077s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.112s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:51 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-662cbb1c-064d-4c75-8ce9-38f650393ecc tempest-GroupSnapshotsTest-1713684335 None] Create group from source-snapshot-2f72b98e-093b-464a-928b-3c61615ce5cc completed successfully. Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "cinder-quobyte-483de6a1-8591-4c0c-8606-8ddae5f438d8" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-483de6a1-8591-4c0c-8606-8ddae5f438d8" acquired by "delete_volume" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[19456dc1-db7a-48ce-99ff-4f24d5db5c64]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-483de6a1-8591-4c0c-8606-8ddae5f438d8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:53 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-483de6a1-8591-4c0c-8606-8ddae5f438d8 Sep 07 13:48:53 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Flow 'volume_create_manager' (7720dce6-414e-4d4e-9bd6-ea03a92fff7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d325b1-90fb-4d93-b90f-e5323ce08e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d325b1-90fb-4d93-b90f-e5323ce08e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-652804696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd6382d-d626-48a0-b590-dfa33ae60afd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a2728e4bc5441788b6fbea97c57bfee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:54Z,use_quota=True,user_id='d165b8dae5be44c6a0efb5bcc46868e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc33c866-4648-4eeb-adb7-3a2d957805bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc33c866-4648-4eeb-adb7-3a2d957805bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d94f42-9cc7-4869-b048-6675b5c3776e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59d94f42-9cc7-4869-b048-6675b5c3776e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cd6382d-d626-48a0-b590-dfa33ae60afd', 'volume_name': 'volume-7cd6382d-d626-48a0-b590-dfa33ae60afd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774b1765-5d2d-4a85-9f6c-8374295e8814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (774b1765-5d2d-4a85-9f6c-8374295e8814) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0702819-4607-49d6-9524-e43d00153454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Volume 7cd6382d-d626-48a0-b590-dfa33ae60afd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cd6382d-d626-48a0-b590-dfa33ae60afd', 'volume_size': 1} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-652804696',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cd6382d-d626-48a0-b590-dfa33ae60afd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a2728e4bc5441788b6fbea97c57bfee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:54Z,use_quota=True,user_id='d165b8dae5be44c6a0efb5bcc46868e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Creating volume 7cd6382d-d626-48a0-b590-dfa33ae60afd {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:48:53 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:48:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7cd6382d-d626-48a0-b590-dfa33ae60afd 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:53 devstack sudo[94671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7cd6382d-d626-48a0-b590-dfa33ae60afd 1073741824 Sep 07 13:48:53 devstack sudo[94671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:54 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-483de6a1-8591-4c0c-8606-8ddae5f438d8" returned: 0 in 0.583s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-483de6a1-8591-4c0c-8606-8ddae5f438d8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:54 devstack sudo[94676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-483de6a1-8591-4c0c-8606-8ddae5f438d8 Sep 07 13:48:54 devstack sudo[94676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:54 devstack sudo[94676]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-483de6a1-8591-4c0c-8606-8ddae5f438d8" returned: 0 in 0.771s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-483de6a1-8591-4c0c-8606-8ddae5f438d8" released by "delete_volume" :: held 1.461s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:54 devstack sudo[94671]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7cd6382d-d626-48a0-b590-dfa33ae60afd 1073741824" returned: 0 in 1.108s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7cd6382d-d626-48a0-b590-dfa33ae60afd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:55 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Created reservations ['9a6f77f1-6c78-47ce-9dfd-f2c936807672'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:55 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7cd6382d-d626-48a0-b590-dfa33ae60afd Sep 07 13:48:55 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:55 devstack cinder-volume[87444]: WARNING cinder.quota [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1930613939 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1930613939, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:48:55 devstack cinder-volume[87444]: WARNING cinder.quota [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1930613939 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1930613939, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:48:55 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Created reservations ['7aee62ca-ae4a-4588-86b4-1959c00a9ea1', '623a87cc-faf4-44be-846a-b5c1b5f5c829', '9cd65125-1e8e-4c5b-8bbf-fe1003cd5f3e', 'b7132a2a-4449-48a1-b5fe-c57960b5ca2f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:55 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7cd6382d-d626-48a0-b590-dfa33ae60afd" returned: 0 in 0.677s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:48:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:55 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:48:55 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0702819-4607-49d6-9524-e43d00153454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cd6382d-d626-48a0-b590-dfa33ae60afd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8af5b05-11f5-46b9-8f36-849d648a2edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:55 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Volume volume-7cd6382d-d626-48a0-b590-dfa33ae60afd (7cd6382d-d626-48a0-b590-dfa33ae60afd): created successfully Sep 07 13:48:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8af5b05-11f5-46b9-8f36-849d648a2edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Flow 'volume_create_manager' (7720dce6-414e-4d4e-9bd6-ea03a92fff7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:55 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ff2215a8-806c-40f0-a362-b5573d078b11 tempest-VolumesListTestJSON-186343945 None] Created volume successfully. Sep 07 13:48:56 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.520s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:56 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:48:56 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5d29db8f-a4e0-455e-bc6a-0481e8d6eee3 tempest-GroupSnapshotsTest-1713684335 None] Delete group completed successfully. Sep 07 13:48:56 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] group_snapshot 2f72b98e-093b-464a-928b-3c61615ce5cc: deleting Sep 07 13:48:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] group_snapshot 2f72b98e-093b-464a-928b-3c61615ce5cc: deleting {{(pid=87444) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 13:48:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "cinder-quobyte-0e80fc06-d3d2-4d90-9378-164f6b98fbb9" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-0e80fc06-d3d2-4d90-9378-164f6b98fbb9" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "cinder-quobyte-c01a0595-0798-4dc3-bc6e-0e6b4c04951f" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:48:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-c01a0595-0798-4dc3-bc6e-0e6b4c04951f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:48:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] Deleting offline snapshot c01a0595-0798-4dc3-bc6e-0e6b4c04951f of volume 0e80fc06-d3d2-4d90-9378-164f6b98fbb9 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:48:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] snapshot_file for this snap is: volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:48:56 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d43bc5-ca02-4532-9903-ce3362395ce8]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:56 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f Sep 07 13:48:56 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:57 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f" returned: 0 in 0.552s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[febe8787-d2f2-40df-81ff-700b9cac6a7c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:57 devstack sudo[94789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 Sep 07 13:48:57 devstack sudo[94789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Flow 'volume_create_manager' (f01f7146-1d2c-40ab-8808-f1fa22356dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df45da43-9d07-4bae-b0bf-a90545940743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df45da43-9d07-4bae-b0bf-a90545940743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-451946423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa6435a-29f2-4b6e-bdc5-506cbef350d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a2728e4bc5441788b6fbea97c57bfee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:58Z,use_quota=True,user_id='d165b8dae5be44c6a0efb5bcc46868e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8882b7-1265-49b7-b8cc-b8cc9427b716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8882b7-1265-49b7-b8cc-b8cc9427b716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4e3e7e-ce03-4e8b-ad00-7b133c9790d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b4e3e7e-ce03-4e8b-ad00-7b133c9790d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaa6435a-29f2-4b6e-bdc5-506cbef350d6', 'volume_name': 'volume-eaa6435a-29f2-4b6e-bdc5-506cbef350d6', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ffe64f-bc68-4e94-9669-9bdf72a4721e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ffe64f-bc68-4e94-9669-9bdf72a4721e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9ce2e8-683d-4f28-b285-26d4faf1122c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:57 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Volume eaa6435a-29f2-4b6e-bdc5-506cbef350d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaa6435a-29f2-4b6e-bdc5-506cbef350d6', 'volume_size': 1} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-451946423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaa6435a-29f2-4b6e-bdc5-506cbef350d6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a2728e4bc5441788b6fbea97c57bfee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:48:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:48:58Z,use_quota=True,user_id='d165b8dae5be44c6a0efb5bcc46868e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Creating volume eaa6435a-29f2-4b6e-bdc5-506cbef350d6 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:48:57 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eaa6435a-29f2-4b6e-bdc5-506cbef350d6 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:57 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eaa6435a-29f2-4b6e-bdc5-506cbef350d6 1073741824 Sep 07 13:48:57 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:57 devstack sudo[94789]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9" returned: 0 in 0.721s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:57 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f Sep 07 13:48:57 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:58 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f" returned: 0 in 0.371s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:58 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f Sep 07 13:48:58 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:58 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eaa6435a-29f2-4b6e-bdc5-506cbef350d6 1073741824" returned: 0 in 0.526s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eaa6435a-29f2-4b6e-bdc5-506cbef350d6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:48:58 devstack sudo[94807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eaa6435a-29f2-4b6e-bdc5-506cbef350d6 Sep 07 13:48:58 devstack sudo[94807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:48:58 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9.c01a0595-0798-4dc3-bc6e-0e6b4c04951f" returned: 0 in 0.306s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-c01a0595-0798-4dc3-bc6e-0e6b4c04951f" released by "_delete_snapshot" :: held 2.089s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-0e80fc06-d3d2-4d90-9378-164f6b98fbb9" released by "delete_snapshot" :: held 2.125s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:48:58 devstack sudo[94807]: pam_unix(sudo:session): session closed for user root Sep 07 13:48:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eaa6435a-29f2-4b6e-bdc5-506cbef350d6" returned: 0 in 0.336s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:48:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:48:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:48:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d9ce2e8-683d-4f28-b285-26d4faf1122c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaa6435a-29f2-4b6e-bdc5-506cbef350d6', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18850423-6a1c-4b60-9fa4-937e01e0e1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:48:58 devstack cinder-volume[87444]: WARNING cinder.quota [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1930613939 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1930613939, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:48:58 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Volume volume-eaa6435a-29f2-4b6e-bdc5-506cbef350d6 (eaa6435a-29f2-4b6e-bdc5-506cbef350d6): created successfully Sep 07 13:48:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18850423-6a1c-4b60-9fa4-937e01e0e1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:48:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Flow 'volume_create_manager' (f01f7146-1d2c-40ab-8808-f1fa22356dd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:48:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-89be5acd-ada2-4c7e-a889-0564bf35e461 tempest-VolumesListTestJSON-186343945 None] Created volume successfully. Sep 07 13:48:58 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] Created reservations ['b490c1f9-1c8e-4c20-bb88-bd34274aa179', '274d7285-07db-484f-8d09-d372fdcbbd2b', '5e250018-3002-4cc9-8117-7d4e9050590c', '9801ede7-e2c6-4bf9-b577-419d0034faf3'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:48:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-566b55b5-bb2f-4fd0-abf6-12b76c85b404 tempest-GroupSnapshotsTest-1713684335 None] group_snapshot 2f72b98e-093b-464a-928b-3c61615ce5cc: deleted successfully Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "cinder-quobyte-0e80fc06-d3d2-4d90-9378-164f6b98fbb9" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-0e80fc06-d3d2-4d90-9378-164f6b98fbb9" acquired by "delete_volume" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1663c9-f5af-4503-b410-718369a407c3]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Flow 'volume_create_manager' (61e08ff3-13b5-4b79-b10d-9f7e5fcd3eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d564a26b-6783-4d62-b810-532bf46747f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d564a26b-6783-4d62-b810-532bf46747f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1282530844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66e997e-1cfe-4353-a61f-73fd0400a360,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a2728e4bc5441788b6fbea97c57bfee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:00Z,use_quota=True,user_id='d165b8dae5be44c6a0efb5bcc46868e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d96586-7423-40b8-a45e-c348972a7d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d96586-7423-40b8-a45e-c348972a7d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259893fa-fbc2-4220-a0d4-8f6499529f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (259893fa-fbc2-4220-a0d4-8f6499529f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c66e997e-1cfe-4353-a61f-73fd0400a360', 'volume_name': 'volume-c66e997e-1cfe-4353-a61f-73fd0400a360', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a5712a-ab66-4e21-9fa1-48f377e59998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70a5712a-ab66-4e21-9fa1-48f377e59998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e2a087-1e38-4ae2-adda-14283a87251f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:00 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Volume c66e997e-1cfe-4353-a61f-73fd0400a360: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c66e997e-1cfe-4353-a61f-73fd0400a360', 'volume_size': 1} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1282530844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c66e997e-1cfe-4353-a61f-73fd0400a360,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6a2728e4bc5441788b6fbea97c57bfee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:00Z,use_quota=True,user_id='d165b8dae5be44c6a0efb5bcc46868e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Creating volume c66e997e-1cfe-4353-a61f-73fd0400a360 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:00 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c66e997e-1cfe-4353-a61f-73fd0400a360 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:00 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 Sep 07 13:49:00 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:00 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c66e997e-1cfe-4353-a61f-73fd0400a360 1073741824 Sep 07 13:49:00 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:00 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9" returned: 0 in 0.470s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:01 devstack sudo[94823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9 Sep 07 13:49:01 devstack sudo[94823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:01 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c66e997e-1cfe-4353-a61f-73fd0400a360 1073741824" returned: 0 in 0.492s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c66e997e-1cfe-4353-a61f-73fd0400a360 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:01 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c66e997e-1cfe-4353-a61f-73fd0400a360 Sep 07 13:49:01 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:01 devstack sudo[94823]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0e80fc06-d3d2-4d90-9378-164f6b98fbb9" returned: 0 in 0.308s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-0e80fc06-d3d2-4d90-9378-164f6b98fbb9" released by "delete_volume" :: held 0.909s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] Created reservations ['142cf2d0-0695-4731-ae5d-fda4f01a336b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:01 devstack cinder-volume[87444]: WARNING cinder.db.api [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1930613939'] Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] Created reservations ['8e30242e-5736-4ad4-be08-c7884bbfda80', '797cf8c0-11a7-488f-9a3c-703d0105e4f8', 'f9444189-6e4c-4974-afc7-04d8dd341f09', '7a8290ee-27ce-41cc-9ce7-878a4ea56be9'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:01 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c66e997e-1cfe-4353-a61f-73fd0400a360" returned: 0 in 0.314s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16e2a087-1e38-4ae2-adda-14283a87251f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c66e997e-1cfe-4353-a61f-73fd0400a360', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c0f2a3-39b8-40bc-b2a1-0da864dc4f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:01 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Volume volume-c66e997e-1cfe-4353-a61f-73fd0400a360 (c66e997e-1cfe-4353-a61f-73fd0400a360): created successfully Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c0f2a3-39b8-40bc-b2a1-0da864dc4f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Flow 'volume_create_manager' (61e08ff3-13b5-4b79-b10d-9f7e5fcd3eba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1a554971-3b37-4f97-ab71-8dfa3a59d6de tempest-VolumesListTestJSON-186343945 None] Created volume successfully. Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:01 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:49:01 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:01 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.249s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:01 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c79614d6-3a3a-4038-94e5-b88de32679b9 tempest-GroupSnapshotsTest-1713684335 None] Delete group completed successfully. Sep 07 13:49:03 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5a21736a-3410-406c-995c-11c7492f752f tempest-GroupSnapshotsTest-1713684335 None] Group tempest-GroupSnapshotsTest-Group-1624874946: creating Sep 07 13:49:03 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5a21736a-3410-406c-995c-11c7492f752f tempest-GroupSnapshotsTest-1713684335 None] Group tempest-GroupSnapshotsTest-Group-1624874946: created successfully Sep 07 13:49:03 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5a21736a-3410-406c-995c-11c7492f752f tempest-GroupSnapshotsTest-1713684335 None] Create group completed successfully. Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Flow 'volume_create_manager' (fa60ef62-946b-4122-82e1-9601fa3bcf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67922457-ab50-4e96-9968-3079ed3df4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67922457-ab50-4e96-9968-3079ed3df4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1950326713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db7b5bc2-2303-4a9a-b011-5c2525abcf23,host='devstack@QuobyteHD#QuobyteHD',id=bd1822ab-b241-4f88-9169-030f927002a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c21ee7999f04f48a341bbc7b7f07c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:05Z,use_quota=True,user_id='d7af12c7402942118e3379237a151512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(789ea73d-720b-400a-86a5-7042922dd634),volume_type_id=789ea73d-720b-400a-86a5-7042922dd634)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14fcb5c6-a873-4e5b-953b-36a06dd8555d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14fcb5c6-a873-4e5b-953b-36a06dd8555d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bab3042-05f2-4264-9ad9-66d770932d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bab3042-05f2-4264-9ad9-66d770932d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd1822ab-b241-4f88-9169-030f927002a8', 'volume_name': 'volume-bd1822ab-b241-4f88-9169-030f927002a8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08236d27-cb58-419b-9e9a-eee8f815b23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08236d27-cb58-419b-9e9a-eee8f815b23f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4359df9-4a37-446d-a45a-cdd5fe6033e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:05 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Volume bd1822ab-b241-4f88-9169-030f927002a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd1822ab-b241-4f88-9169-030f927002a8', 'volume_size': 1} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db7b5bc2-2303-4a9a-b011-5c2525abcf23,created_at=2026-09-07T11:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1950326713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db7b5bc2-2303-4a9a-b011-5c2525abcf23,host='devstack@QuobyteHD#QuobyteHD',id=bd1822ab-b241-4f88-9169-030f927002a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c21ee7999f04f48a341bbc7b7f07c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:05Z,use_quota=True,user_id='d7af12c7402942118e3379237a151512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(789ea73d-720b-400a-86a5-7042922dd634),volume_type_id=789ea73d-720b-400a-86a5-7042922dd634)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Creating volume bd1822ab-b241-4f88-9169-030f927002a8 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:05 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:05 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8 1073741824 Sep 07 13:49:05 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Acquiring lock "cinder-c66e997e-1cfe-4353-a61f-73fd0400a360-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Lock "cinder-c66e997e-1cfe-4353-a61f-73fd0400a360-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Acquiring lock "cinder-quobyte-c66e997e-1cfe-4353-a61f-73fd0400a360" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Lock "cinder-quobyte-c66e997e-1cfe-4353-a61f-73fd0400a360" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[079996b3-549b-4adc-9943-4a362b81e686]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c66e997e-1cfe-4353-a61f-73fd0400a360 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:06 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8 1073741824" returned: 0 in 0.581s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:06 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8 Sep 07 13:49:06 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:06 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c66e997e-1cfe-4353-a61f-73fd0400a360 Sep 07 13:49:06 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:06 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8" returned: 0 in 0.309s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4359df9-4a37-446d-a45a-cdd5fe6033e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd1822ab-b241-4f88-9169-030f927002a8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e66ef6-fcc9-4deb-a0a6-e90ec714195d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:06 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Volume volume-bd1822ab-b241-4f88-9169-030f927002a8 (bd1822ab-b241-4f88-9169-030f927002a8): created successfully Sep 07 13:49:06 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e66ef6-fcc9-4deb-a0a6-e90ec714195d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Flow 'volume_create_manager' (fa60ef62-946b-4122-82e1-9601fa3bcf4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c66e997e-1cfe-4353-a61f-73fd0400a360" returned: 0 in 0.445s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c66e997e-1cfe-4353-a61f-73fd0400a360 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b3939f3d-1d1d-4e5b-a6ea-25c7f8f09ca3 tempest-GroupSnapshotsTest-1713684335 None] Created volume successfully. Sep 07 13:49:06 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c66e997e-1cfe-4353-a61f-73fd0400a360 Sep 07 13:49:06 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:06 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c66e997e-1cfe-4353-a61f-73fd0400a360" returned: 0 in 0.279s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Lock "cinder-quobyte-c66e997e-1cfe-4353-a61f-73fd0400a360" released by "delete_volume" :: held 0.780s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Created reservations ['a0f5f3f6-c7f9-4229-b268-7dd879da6415', 'c4ee3416-7828-4d25-9488-6b6965027a60', '761c81e4-d17c-4a2c-9f75-b91ed69b81af', 'c62b66b5-52bf-4626-9eb3-d8833905a136'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:06 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:49:06 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:07 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.293s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Deleted volume successfully. Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Acquiring lock "cinder-eaa6435a-29f2-4b6e-bdc5-506cbef350d6-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Lock "cinder-eaa6435a-29f2-4b6e-bdc5-506cbef350d6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fce7cdf6-5b0d-45fb-82a1-e09ba41f4842 tempest-VolumesListTestJSON-186343945 None] Lock "cinder-c66e997e-1cfe-4353-a61f-73fd0400a360-delete_volume" released by "delete_volume" :: held 1.401s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Acquiring lock "cinder-quobyte-eaa6435a-29f2-4b6e-bdc5-506cbef350d6" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Lock "cinder-quobyte-eaa6435a-29f2-4b6e-bdc5-506cbef350d6" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5384da76-8f32-46f6-b98a-f35d580a6f4d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eaa6435a-29f2-4b6e-bdc5-506cbef350d6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Flow 'volume_create_manager' (abe5b6c8-587d-4ad6-848d-d949dd3cdf72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81676162-1eb4-495a-a644-b42eb4a12922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81676162-1eb4-495a-a644-b42eb4a12922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1101689372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db7b5bc2-2303-4a9a-b011-5c2525abcf23,host='devstack@QuobyteHD#QuobyteHD',id=d546b5fb-3969-4079-b1b2-89c2cc7850e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c21ee7999f04f48a341bbc7b7f07c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:07Z,use_quota=True,user_id='d7af12c7402942118e3379237a151512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(789ea73d-720b-400a-86a5-7042922dd634),volume_type_id=789ea73d-720b-400a-86a5-7042922dd634)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4ef413-9be5-4af5-bd48-3510ab4b3f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4ef413-9be5-4af5-bd48-3510ab4b3f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b318bc0-6a9a-4718-a79a-5a20b0343ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:07 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eaa6435a-29f2-4b6e-bdc5-506cbef350d6 Sep 07 13:49:07 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b318bc0-6a9a-4718-a79a-5a20b0343ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd546b5fb-3969-4079-b1b2-89c2cc7850e9', 'volume_name': 'volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5400ae65-d123-480f-be92-03a5c53bda77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5400ae65-d123-480f-be92-03a5c53bda77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1edfecf-c963-4b25-aa22-63d775de3d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:07 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Volume d546b5fb-3969-4079-b1b2-89c2cc7850e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9', 'volume_size': 1} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=db7b5bc2-2303-4a9a-b011-5c2525abcf23,created_at=2026-09-07T11:49:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1101689372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=db7b5bc2-2303-4a9a-b011-5c2525abcf23,host='devstack@QuobyteHD#QuobyteHD',id=d546b5fb-3969-4079-b1b2-89c2cc7850e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c21ee7999f04f48a341bbc7b7f07c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:07Z,use_quota=True,user_id='d7af12c7402942118e3379237a151512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(789ea73d-720b-400a-86a5-7042922dd634),volume_type_id=789ea73d-720b-400a-86a5-7042922dd634)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Creating volume d546b5fb-3969-4079-b1b2-89c2cc7850e9 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:07 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:07 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 1073741824 Sep 07 13:49:07 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:07 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eaa6435a-29f2-4b6e-bdc5-506cbef350d6" returned: 0 in 0.438s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eaa6435a-29f2-4b6e-bdc5-506cbef350d6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:07 devstack sudo[94880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eaa6435a-29f2-4b6e-bdc5-506cbef350d6 Sep 07 13:49:07 devstack sudo[94880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:08 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 1073741824" returned: 0 in 0.482s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:08 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 Sep 07 13:49:08 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:08 devstack sudo[94880]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eaa6435a-29f2-4b6e-bdc5-506cbef350d6" returned: 0 in 0.320s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Lock "cinder-quobyte-eaa6435a-29f2-4b6e-bdc5-506cbef350d6" released by "delete_volume" :: held 0.838s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Created reservations ['e6a66443-c95b-426d-9d73-124730b6fae9', 'ce4d9ed6-7ad4-4310-927a-9bbce2aa3fff', '317e9ba0-3f3f-4f75-a728-b13f82326b9b', 'f0bedbb4-de45-40eb-9a75-df29a94cb0be'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:08 devstack sudo[94887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:49:08 devstack sudo[94887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:08 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9" returned: 0 in 0.312s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1edfecf-c963-4b25-aa22-63d775de3d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff889111-4ed8-4fc8-abc7-efa4120eff5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:08 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Volume volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 (d546b5fb-3969-4079-b1b2-89c2cc7850e9): created successfully Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff889111-4ed8-4fc8-abc7-efa4120eff5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Flow 'volume_create_manager' (abe5b6c8-587d-4ad6-848d-d949dd3cdf72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9888b2d9-7885-4d01-ba9b-ba943d6eca08 tempest-GroupSnapshotsTest-1713684335 None] Created volume successfully. Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Acquiring lock "cinder-7cd6382d-d626-48a0-b590-dfa33ae60afd-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Lock "cinder-7cd6382d-d626-48a0-b590-dfa33ae60afd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:08 devstack sudo[94887]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.342s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Deleted volume successfully. Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Acquiring lock "cinder-quobyte-7cd6382d-d626-48a0-b590-dfa33ae60afd" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b4803a48-c5c9-42c3-a786-1a3f097b5c1b tempest-VolumesListTestJSON-186343945 None] Lock "cinder-eaa6435a-29f2-4b6e-bdc5-506cbef350d6-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Lock "cinder-quobyte-7cd6382d-d626-48a0-b590-dfa33ae60afd" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edf41ef-d1ae-4616-92b3-559cfcc2947a]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7cd6382d-d626-48a0-b590-dfa33ae60afd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:08 devstack sudo[94891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7cd6382d-d626-48a0-b590-dfa33ae60afd Sep 07 13:49:08 devstack sudo[94891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4f3952f3-6a8b-460c-b213-cfd728e4e63a tempest-GroupSnapshotsTest-1713684335 None] Update group completed successfully. Sep 07 13:49:09 devstack sudo[94891]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7cd6382d-d626-48a0-b590-dfa33ae60afd" returned: 0 in 0.426s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7cd6382d-d626-48a0-b590-dfa33ae60afd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:09 devstack sudo[94896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7cd6382d-d626-48a0-b590-dfa33ae60afd Sep 07 13:49:09 devstack sudo[94896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:09 devstack sudo[94896]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7cd6382d-d626-48a0-b590-dfa33ae60afd" returned: 0 in 0.254s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Lock "cinder-quobyte-7cd6382d-d626-48a0-b590-dfa33ae60afd" released by "delete_volume" :: held 0.723s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:09 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Created reservations ['7d93114d-0b6c-49e1-89c6-6cb8daa97e40', '20b64eec-7d86-4fb3-9041-99bcf7a14b8f', '2104f53a-653c-47ad-ac9d-d4ecf469a7a3', '5a1cf80e-ccc8-4861-a814-aa60c280d9b1'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:09 devstack sudo[94915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:49:09 devstack sudo[94915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:09 devstack sudo[94915]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.272s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:09 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Deleted volume successfully. Sep 07 13:49:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-afb9a63e-8fec-431a-9f95-4b9e2661a7c5 tempest-VolumesListTestJSON-186343945 None] Lock "cinder-7cd6382d-d626-48a0-b590-dfa33ae60afd-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-51328b9e-242e-419c-a1e0-20d7975e9880 tempest-GroupSnapshotsTest-1713684335 None] Update group completed successfully. Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Flow 'volume_create_manager' (5ba00b68-a11e-4105-b4a8-0338824ce314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b1dcaf-de11-4f7a-b8ad-8353addeebbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4b1dcaf-de11-4f7a-b8ad-8353addeebbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2025050673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe27bc94-373e-47d5-a16b-52426b7b55f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7792af140c484bb3f08f30d6a61f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:11Z,use_quota=True,user_id='7c0c2be5c26143afa325b8f3fd8c0e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3384ac4d-49c7-4139-987b-f9552ad74413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3384ac4d-49c7-4139-987b-f9552ad74413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92da9311-283b-4000-b9f0-4b530e573b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92da9311-283b-4000-b9f0-4b530e573b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe27bc94-373e-47d5-a16b-52426b7b55f4', 'volume_name': 'volume-fe27bc94-373e-47d5-a16b-52426b7b55f4', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d95d96c-3a1a-467f-ba93-4d3a4c3c1ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d95d96c-3a1a-467f-ba93-4d3a4c3c1ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9147ba9-8ffc-4cd5-851d-6bd0801883ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:11 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Volume fe27bc94-373e-47d5-a16b-52426b7b55f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe27bc94-373e-47d5-a16b-52426b7b55f4', 'volume_size': 1} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-2025050673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe27bc94-373e-47d5-a16b-52426b7b55f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7792af140c484bb3f08f30d6a61f28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:11Z,use_quota=True,user_id='7c0c2be5c26143afa325b8f3fd8c0e47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Creating volume fe27bc94-373e-47d5-a16b-52426b7b55f4 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:11 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe27bc94-373e-47d5-a16b-52426b7b55f4 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:11 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe27bc94-373e-47d5-a16b-52426b7b55f4 1073741824 Sep 07 13:49:11 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:11 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-956e5c9f-ab81-4030-9a50-df3a790898f8 tempest-GroupSnapshotsTest-1713684335 None] Update group completed successfully. Sep 07 13:49:11 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe27bc94-373e-47d5-a16b-52426b7b55f4 1073741824" returned: 0 in 0.502s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe27bc94-373e-47d5-a16b-52426b7b55f4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:11 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe27bc94-373e-47d5-a16b-52426b7b55f4 Sep 07 13:49:11 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:12 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe27bc94-373e-47d5-a16b-52426b7b55f4" returned: 0 in 0.306s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9147ba9-8ffc-4cd5-851d-6bd0801883ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe27bc94-373e-47d5-a16b-52426b7b55f4', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe40931f-ec0d-4558-8739-64a7e68c618e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:12 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Volume volume-fe27bc94-373e-47d5-a16b-52426b7b55f4 (fe27bc94-373e-47d5-a16b-52426b7b55f4): created successfully Sep 07 13:49:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe40931f-ec0d-4558-8739-64a7e68c618e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Flow 'volume_create_manager' (5ba00b68-a11e-4105-b4a8-0338824ce314) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c86be94b-ee4a-4512-b37c-b964f1ceb7c2 tempest-AttachVolumeShelveTestJSON-1571689035 None] Created volume successfully. Sep 07 13:49:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-15f13496-f0ec-49bc-beb2-285c9bf716a3 tempest-GroupSnapshotsTest-1713684335 None] Update group completed successfully. Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Flow 'volume_create_manager' (750ab39d-753c-4afa-87ca-3e49deab41a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2686a0-7011-4c45-9422-65956fb3c565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] GroupSnapshot 8bd9e753-fbdd-45e7-995f-e5a2e1c5934d: creating. Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2686a0-7011-4c45-9422-65956fb3c565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1135560396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f907319e-3648-4b8a-9b06-617ef08b7aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bdfe0edf7154944bee41076df12a3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:14Z,use_quota=True,user_id='8ad16be5f4544e739130e844fd5b7839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fa0c41-fe43-46cd-ad0b-4f3670c34778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08fa0c41-fe43-46cd-ad0b-4f3670c34778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3487792-321e-4489-8edc-26c1389e300f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3487792-321e-4489-8edc-26c1389e300f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f907319e-3648-4b8a-9b06-617ef08b7aee', 'volume_name': 'volume-f907319e-3648-4b8a-9b06-617ef08b7aee', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b22e4b-7a67-41b1-ba58-bf44e22d3f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5b22e4b-7a67-41b1-ba58-bf44e22d3f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5df5f0-b169-4642-a815-b73eb8e527cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:14 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Volume f907319e-3648-4b8a-9b06-617ef08b7aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f907319e-3648-4b8a-9b06-617ef08b7aee', 'volume_size': 1} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1135560396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f907319e-3648-4b8a-9b06-617ef08b7aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bdfe0edf7154944bee41076df12a3e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:14Z,use_quota=True,user_id='8ad16be5f4544e739130e844fd5b7839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Creating volume f907319e-3648-4b8a-9b06-617ef08b7aee {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:14 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f907319e-3648-4b8a-9b06-617ef08b7aee 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:14 devstack sudo[94934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f907319e-3648-4b8a-9b06-617ef08b7aee 1073741824 Sep 07 13:49:14 devstack sudo[94934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Group snapshot 8bd9e753-fbdd-45e7-995f-e5a2e1c5934d: creating. {{(pid=87444) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:14 devstack sudo[94934]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f907319e-3648-4b8a-9b06-617ef08b7aee 1073741824" returned: 0 in 0.505s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f907319e-3648-4b8a-9b06-617ef08b7aee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:14 devstack sudo[94942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f907319e-3648-4b8a-9b06-617ef08b7aee Sep 07 13:49:14 devstack sudo[94942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:15 devstack sudo[94942]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f907319e-3648-4b8a-9b06-617ef08b7aee" returned: 0 in 0.363s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.874s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5df5f0-b169-4642-a815-b73eb8e527cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f907319e-3648-4b8a-9b06-617ef08b7aee', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95a630d-63a1-44c0-bdbe-48ec671d633b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Creating offline snapshot 02bd52ba-813e-46b0-b7a1-b3a0388626db of volume d546b5fb-3969-4079-b1b2-89c2cc7850e9 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:49:15 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Volume volume-f907319e-3648-4b8a-9b06-617ef08b7aee (f907319e-3648-4b8a-9b06-617ef08b7aee): created successfully Sep 07 13:49:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95a630d-63a1-44c0-bdbe-48ec671d633b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Flow 'volume_create_manager' (750ab39d-753c-4afa-87ca-3e49deab41a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:15 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2a090c-e365-4343-ac6a-bbd2a2ec1161]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:15 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-93abe36e-58ea-4659-b51e-72654e5b93e9 tempest-VolumesNegativeTest-1469807904 None] Created volume successfully. Sep 07 13:49:15 devstack sudo[94951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 Sep 07 13:49:15 devstack sudo[94951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:15 devstack sudo[94951]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9" returned: 0 in 0.596s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:15 devstack sudo[94963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db 1G Sep 07 13:49:15 devstack sudo[94963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:16 devstack sudo[94963]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db 1G" returned: 0 in 0.599s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:16 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db Sep 07 13:49:16 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:16 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db" returned: 0 in 0.375s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:16 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:49:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:16 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db Sep 07 13:49:16 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:17 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db" returned: 0 in 0.411s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:17 devstack sudo[94980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.info Sep 07 13:49:17 devstack sudo[94980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:17 devstack sudo[94980]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.info" returned: 0 in 0.368s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:17 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:49:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:17 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.info Sep 07 13:49:17 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:18 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.info" returned: 0 in 0.346s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.874s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Creating offline snapshot 8e754373-7862-451d-92a0-92a114109933 of volume bd1822ab-b241-4f88-9169-030f927002a8 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:49:18 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0e1d3c-ac9c-4e7c-9f3b-7edeb967f28b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:18 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8 Sep 07 13:49:18 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:18 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8" returned: 0 in 0.460s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:18 devstack sudo[94992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933 1G Sep 07 13:49:18 devstack sudo[94992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:19 devstack sudo[94992]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933 1G" returned: 0 in 0.756s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1822ab-b241-4f88-9169-030f927002a8 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:19 devstack sudo[95006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1822ab-b241-4f88-9169-030f927002a8 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933 Sep 07 13:49:19 devstack sudo[95006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:19 devstack sudo[95006]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd1822ab-b241-4f88-9169-030f927002a8 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933" returned: 0 in 0.499s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:19 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:49:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:19 devstack sudo[95021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933 Sep 07 13:49:19 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:20 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933" returned: 0 in 0.292s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:20 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.info Sep 07 13:49:20 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:20 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.info" returned: 0 in 0.341s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:20 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:49:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:20 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.info Sep 07 13:49:20 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:20 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.info" returned: 0 in 0.398s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.876s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Flow 'volume_create_manager' (bfc67461-ceee-4d35-ab2e-ee6e11730938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d816c44-07d5-4ff1-bf8b-70265691fc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d816c44-07d5-4ff1-bf8b-70265691fc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1678133672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70a087e-baad-497d-b049-7664b49d4b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fbe7ad1c9334e1e8536e7491e731420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:21Z,use_quota=True,user_id='e000ef6d98e94c138334b582096fdeee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b6dc14-b63d-4779-bfca-8856f4efa674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b6dc14-b63d-4779-bfca-8856f4efa674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b543003c-194b-40c3-b64b-7d6f44d464e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b543003c-194b-40c3-b64b-7d6f44d464e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c70a087e-baad-497d-b049-7664b49d4b1c', 'volume_name': 'volume-c70a087e-baad-497d-b049-7664b49d4b1c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d9abb4-11f6-4867-b5f0-9802fb89b2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d9abb4-11f6-4867-b5f0-9802fb89b2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0602205d-9329-4756-bbce-7000c4e46fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:21 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Volume c70a087e-baad-497d-b049-7664b49d4b1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c70a087e-baad-497d-b049-7664b49d4b1c', 'volume_size': 1} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1678133672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c70a087e-baad-497d-b049-7664b49d4b1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fbe7ad1c9334e1e8536e7491e731420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:21Z,use_quota=True,user_id='e000ef6d98e94c138334b582096fdeee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Creating volume c70a087e-baad-497d-b049-7664b49d4b1c {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:21 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c70a087e-baad-497d-b049-7664b49d4b1c 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:21 devstack sudo[95034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c70a087e-baad-497d-b049-7664b49d4b1c 1073741824 Sep 07 13:49:21 devstack sudo[95034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7ee4b345-52f3-45a6-b932-6a189b5baeac tempest-GroupSnapshotsTest-1713684335 None] group_snapshot 8bd9e753-fbdd-45e7-995f-e5a2e1c5934d: created successfully Sep 07 13:49:21 devstack sudo[95034]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c70a087e-baad-497d-b049-7664b49d4b1c 1073741824" returned: 0 in 0.529s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c70a087e-baad-497d-b049-7664b49d4b1c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:21 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c70a087e-baad-497d-b049-7664b49d4b1c Sep 07 13:49:21 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] group_snapshot 8bd9e753-fbdd-45e7-995f-e5a2e1c5934d: deleting Sep 07 13:49:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] group_snapshot 8bd9e753-fbdd-45e7-995f-e5a2e1c5934d: deleting {{(pid=87444) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "cinder-quobyte-d546b5fb-3969-4079-b1b2-89c2cc7850e9" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-d546b5fb-3969-4079-b1b2-89c2cc7850e9" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "cinder-quobyte-02bd52ba-813e-46b0-b7a1-b3a0388626db" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-02bd52ba-813e-46b0-b7a1-b3a0388626db" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Deleting offline snapshot 02bd52ba-813e-46b0-b7a1-b3a0388626db of volume d546b5fb-3969-4079-b1b2-89c2cc7850e9 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:49:22 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] snapshot_file for this snap is: volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c70a087e-baad-497d-b049-7664b49d4b1c" returned: 0 in 0.405s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9370488d-9364-489f-a9ce-2c7cd19ffd37]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0602205d-9329-4756-bbce-7000c4e46fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c70a087e-baad-497d-b049-7664b49d4b1c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdeda018-18af-41bf-ae27-6ea832691b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:22 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Volume volume-c70a087e-baad-497d-b049-7664b49d4b1c (c70a087e-baad-497d-b049-7664b49d4b1c): created successfully Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdeda018-18af-41bf-ae27-6ea832691b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Flow 'volume_create_manager' (bfc67461-ceee-4d35-ab2e-ee6e11730938) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-04393d28-12ed-4d97-becf-ca9ff425347c tempest-AttachVolumeTestJSON-959586247 None] Created volume successfully. Sep 07 13:49:22 devstack sudo[95045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db Sep 07 13:49:22 devstack sudo[95045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:22 devstack sudo[95045]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db" returned: 0 in 0.687s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcc04ce-c8ec-4f87-bc85-b63361d80f8b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:23 devstack sudo[95068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 Sep 07 13:49:23 devstack sudo[95068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:23 devstack sudo[95068]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9" returned: 0 in 0.492s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:23 devstack sudo[95079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db Sep 07 13:49:23 devstack sudo[95079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:24 devstack sudo[95079]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db" returned: 0 in 0.979s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:24 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db Sep 07 13:49:24 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-e78dce32-bfa8-4fda-90eb-ab2ae8223a0c req-44bca83c-b51f-4a65-8555-0dd4063814b7 tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-e78dce32-bfa8-4fda-90eb-ab2ae8223a0c req-44bca83c-b51f-4a65-8555-0dd4063814b7 tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-e78dce32-bfa8-4fda-90eb-ab2ae8223a0c req-44bca83c-b51f-4a65-8555-0dd4063814b7 tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.051s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-e78dce32-bfa8-4fda-90eb-ab2ae8223a0c req-44bca83c-b51f-4a65-8555-0dd4063814b7 tempest-AttachVolumeTestJSON-959586247 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-c70a087e-baad-497d-b049-7664b49d4b1c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8a427d1a-548d-4abe-9748-7005f09b8c35', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:49:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-e78dce32-bfa8-4fda-90eb-ab2ae8223a0c req-44bca83c-b51f-4a65-8555-0dd4063814b7 tempest-AttachVolumeTestJSON-959586247 None] attachment_update completed successfully. Sep 07 13:49:24 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9.02bd52ba-813e-46b0-b7a1-b3a0388626db" returned: 0 in 0.604s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-02bd52ba-813e-46b0-b7a1-b3a0388626db" released by "_delete_snapshot" :: held 2.981s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-d546b5fb-3969-4079-b1b2-89c2cc7850e9" released by "delete_snapshot" :: held 3.022s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "cinder-quobyte-bd1822ab-b241-4f88-9169-030f927002a8" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-bd1822ab-b241-4f88-9169-030f927002a8" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "cinder-quobyte-8e754373-7862-451d-92a0-92a114109933" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-8e754373-7862-451d-92a0-92a114109933" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Deleting offline snapshot 8e754373-7862-451d-92a0-92a114109933 of volume bd1822ab-b241-4f88-9169-030f927002a8 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:49:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] snapshot_file for this snap is: volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:49:25 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4630e0f8-5f24-42c0-acf2-c9e713cf9981]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:25 devstack sudo[95223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933 Sep 07 13:49:25 devstack sudo[95223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:26 devstack sudo[95223]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933" returned: 0 in 0.752s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd1822ab-b241-4f88-9169-030f927002a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:49:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0c348f-d099-4356-aacd-bd7c1bca827b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-412975da-aab2-47c5-a2e7-bcdb9e4c86b2 req-20f38539-cf5e-45a3-9d01-8079c25c88ed tempest-AttachVolumeShelveTestJSON-1571689035 None] No connector for attachment 9285e846-13f0-4fb9-8446-5d8445666052; skipping storage backend terminate_connection call. {{(pid=87444) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 07 13:49:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-412975da-aab2-47c5-a2e7-bcdb9e4c86b2 req-20f38539-cf5e-45a3-9d01-8079c25c88ed tempest-AttachVolumeShelveTestJSON-1571689035 None] Deleting attachment 9285e846-13f0-4fb9-8446-5d8445666052. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:49:26 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8 Sep 07 13:49:26 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:26 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8" returned: 0 in 0.639s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:26 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933 Sep 07 13:49:26 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:27 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933" returned: 0 in 0.558s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:27 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933 Sep 07 13:49:27 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:27 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8.8e754373-7862-451d-92a0-92a114109933" returned: 0 in 0.557s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-8e754373-7862-451d-92a0-92a114109933" released by "_delete_snapshot" :: held 2.735s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-bd1822ab-b241-4f88-9169-030f927002a8" released by "delete_snapshot" :: held 2.785s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:28 devstack cinder-volume[87444]: WARNING cinder.quota [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1085999008 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1085999008, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:49:28 devstack cinder-volume[87444]: WARNING cinder.quota [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1085999008 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1085999008, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Created reservations ['21f9236b-31f7-4e9b-918c-6f14f876a70a', '4e797058-83c1-45ca-b318-555c594fc5ec', '99914eff-d533-4131-87c9-b307034dc581', '05dd04e8-498e-456f-8739-02bbdfe47949'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Flow 'volume_create_manager' (350e7fe8-3718-4faf-be78-c4716a66bf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94bfd23-523c-499b-b6b9-8d0b1a0a9eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b94bfd23-523c-499b-b6b9-8d0b1a0a9eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1580616076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d57c819-ddbd-4373-a9cb-129fe45e9574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fbe7ad1c9334e1e8536e7491e731420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:28Z,use_quota=True,user_id='e000ef6d98e94c138334b582096fdeee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83757bfc-2027-48e1-ae63-af0d82351ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83757bfc-2027-48e1-ae63-af0d82351ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9e63d6-ca33-4785-8e35-d645e7938c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9e63d6-ca33-4785-8e35-d645e7938c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d57c819-ddbd-4373-a9cb-129fe45e9574', 'volume_name': 'volume-7d57c819-ddbd-4373-a9cb-129fe45e9574', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0977d4-e5a9-405f-a11f-16da280b3d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b0977d4-e5a9-405f-a11f-16da280b3d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e2a44c-b3bf-499e-90ae-0a618a58d92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:28 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Volume 7d57c819-ddbd-4373-a9cb-129fe45e9574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d57c819-ddbd-4373-a9cb-129fe45e9574', 'volume_size': 1} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1580616076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d57c819-ddbd-4373-a9cb-129fe45e9574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fbe7ad1c9334e1e8536e7491e731420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:28Z,use_quota=True,user_id='e000ef6d98e94c138334b582096fdeee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Creating volume 7d57c819-ddbd-4373-a9cb-129fe45e9574 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:28 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d57c819-ddbd-4373-a9cb-129fe45e9574 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:28 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d57c819-ddbd-4373-a9cb-129fe45e9574 1073741824 Sep 07 13:49:28 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:28 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] Created reservations ['08629180-5c1b-4485-93de-7b3f54cef607', '39c48aac-e555-491b-8b2c-26b56a5b6180', '2f432eba-f2a4-4307-a3d8-e3498cdc7c47', 'd29e0b71-a2f3-44c4-aeff-3a35a8b54715'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f76b29e6-4e78-48b4-a99c-9e5959650c97 tempest-GroupSnapshotsTest-1713684335 None] group_snapshot 8bd9e753-fbdd-45e7-995f-e5a2e1c5934d: deleted successfully Sep 07 13:49:29 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d57c819-ddbd-4373-a9cb-129fe45e9574 1073741824" returned: 0 in 0.783s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d57c819-ddbd-4373-a9cb-129fe45e9574 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:29 devstack sudo[95598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d57c819-ddbd-4373-a9cb-129fe45e9574 Sep 07 13:49:29 devstack sudo[95598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:29 devstack sudo[95598]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "cinder-quobyte-bd1822ab-b241-4f88-9169-030f927002a8" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d57c819-ddbd-4373-a9cb-129fe45e9574" returned: 0 in 0.434s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.296s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-bd1822ab-b241-4f88-9169-030f927002a8" acquired by "delete_volume" :: waited 0.038s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (61e2a44c-b3bf-499e-90ae-0a618a58d92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d57c819-ddbd-4373-a9cb-129fe45e9574', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6dec46-6fb0-47c7-9e1e-7a2c85c0282b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[378e74aa-948b-48dc-bcdb-3b866a1d61ee]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:29 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Volume volume-7d57c819-ddbd-4373-a9cb-129fe45e9574 (7d57c819-ddbd-4373-a9cb-129fe45e9574): created successfully Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e6dec46-6fb0-47c7-9e1e-7a2c85c0282b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Flow 'volume_create_manager' (350e7fe8-3718-4faf-be78-c4716a66bf99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:29 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:49:29 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-56da469f-6855-4b35-84b1-14c065e51580 tempest-AttachVolumeTestJSON-959586247 None] Created volume successfully. Sep 07 13:49:29 devstack sudo[95601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8 Sep 07 13:49:29 devstack sudo[95601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:30 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.401s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:49:30 devstack sudo[95601]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8" returned: 0 in 0.515s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:30 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8 Sep 07 13:49:30 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:30 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bd1822ab-b241-4f88-9169-030f927002a8" returned: 0 in 0.349s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-bd1822ab-b241-4f88-9169-030f927002a8" released by "delete_volume" :: held 0.976s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "cinder-quobyte-d546b5fb-3969-4079-b1b2-89c2cc7850e9" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-d546b5fb-3969-4079-b1b2-89c2cc7850e9" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:30 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e4890c3-9f61-4c07-96e7-ce742f8fd8e6]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:30 devstack sudo[95616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 Sep 07 13:49:30 devstack sudo[95616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:31 devstack sudo[95616]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9" returned: 0 in 0.603s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:31 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9 Sep 07 13:49:31 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-c4c49990-e9de-4577-b82c-3e6a0694883a req-c1b9d1bf-48a5-4de3-87ce-60a7c02d628b tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-c4c49990-e9de-4577-b82c-3e6a0694883a req-c1b9d1bf-48a5-4de3-87ce-60a7c02d628b tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-c4c49990-e9de-4577-b82c-3e6a0694883a req-c1b9d1bf-48a5-4de3-87ce-60a7c02d628b tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-c4c49990-e9de-4577-b82c-3e6a0694883a req-c1b9d1bf-48a5-4de3-87ce-60a7c02d628b tempest-AttachVolumeTestJSON-959586247 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-7d57c819-ddbd-4373-a9cb-129fe45e9574', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '108784e2-bfc3-4780-90cd-0a346c42cd0b', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:49:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-c4c49990-e9de-4577-b82c-3e6a0694883a req-c1b9d1bf-48a5-4de3-87ce-60a7c02d628b tempest-AttachVolumeTestJSON-959586247 None] attachment_update completed successfully. Sep 07 13:49:31 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d546b5fb-3969-4079-b1b2-89c2cc7850e9" returned: 0 in 0.323s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-d546b5fb-3969-4079-b1b2-89c2cc7850e9" released by "delete_volume" :: held 1.036s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:31 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Created reservations ['4523ca1e-2c82-4530-927f-9dfe3aacb17d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:31 devstack cinder-volume[87444]: WARNING cinder.quota [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1085999008 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1085999008, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:49:31 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Created reservations ['68a2d3f9-3982-46a0-a3f9-6fb15ae6f835', '0f77b8b9-527e-438d-8e4a-f117ec794e99', 'e2a43bcf-ecf9-4147-b416-35d8c4f2388c', '8d3241d5-f1e0-4b83-ba93-f7cc22e3d731'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:32 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Created reservations ['7050aa3a-d753-48d3-8df8-0226208982dd', '67ce29dc-6806-4755-86fe-0912a500c09f', '7ce181a2-5011-457e-84e8-c1788cc7393c', '9259d016-5758-46a5-9b2c-a49e2530423b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:32 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:49:32 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:32 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.420s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:32 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:32 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-07532542-1bad-48a3-80be-a80bd831d41b tempest-GroupSnapshotsTest-1713684335 None] Delete group completed successfully. Sep 07 13:49:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-85b03cdc-4366-4a0e-a9a7-a18786eb2b66 tempest-GroupSnapshotsTest-1713684335 None] Group tempest-GroupSnapshotsTest-Group-934328178: creating Sep 07 13:49:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-85b03cdc-4366-4a0e-a9a7-a18786eb2b66 tempest-GroupSnapshotsTest-1713684335 None] Group tempest-GroupSnapshotsTest-Group-934328178: created successfully Sep 07 13:49:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-85b03cdc-4366-4a0e-a9a7-a18786eb2b66 tempest-GroupSnapshotsTest-1713684335 None] Create group completed successfully. Sep 07 13:49:34 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-a019392b-beac-481f-a0e3-fdc8a6808c0a req-406aea94-66d9-4c37-814b-c7f7073db876 tempest-AttachVolumeTestJSON-959586247 None] Terminate volume connection completed successfully. Sep 07 13:49:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-a019392b-beac-481f-a0e3-fdc8a6808c0a req-406aea94-66d9-4c37-814b-c7f7073db876 tempest-AttachVolumeTestJSON-959586247 None] Deleting attachment 8a427d1a-548d-4abe-9748-7005f09b8c35. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Flow 'volume_create_manager' (c93ef8c3-86b9-481c-b1a8-d49cd1791023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901290dc-f2c5-49d7-b3dd-66e7266a3d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (901290dc-f2c5-49d7-b3dd-66e7266a3d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2035259169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b4bca7d7-7080-4546-bf8e-77bee9435c18,host='devstack@QuobyteHD#QuobyteHD',id=235f06a2-560e-44e4-b246-e7c0534888bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c21ee7999f04f48a341bbc7b7f07c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:35Z,use_quota=True,user_id='d7af12c7402942118e3379237a151512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cad0f41e-94e0-4247-a102-2cf1e04514ae),volume_type_id=cad0f41e-94e0-4247-a102-2cf1e04514ae)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f850ab4f-c9dc-4ee8-b69a-f9b1ea5c6beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f850ab4f-c9dc-4ee8-b69a-f9b1ea5c6beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4adc6c29-b254-4fa1-a234-8f87d56bcc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4adc6c29-b254-4fa1-a234-8f87d56bcc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '235f06a2-560e-44e4-b246-e7c0534888bb', 'volume_name': 'volume-235f06a2-560e-44e4-b246-e7c0534888bb', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f929b022-c479-451d-a66e-682ab9d7ee3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f929b022-c479-451d-a66e-682ab9d7ee3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622dc832-f540-466c-86c7-868d43e8e60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:35 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Volume 235f06a2-560e-44e4-b246-e7c0534888bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-235f06a2-560e-44e4-b246-e7c0534888bb', 'volume_size': 1} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b4bca7d7-7080-4546-bf8e-77bee9435c18,created_at=2026-09-07T11:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2035259169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b4bca7d7-7080-4546-bf8e-77bee9435c18,host='devstack@QuobyteHD#QuobyteHD',id=235f06a2-560e-44e4-b246-e7c0534888bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c21ee7999f04f48a341bbc7b7f07c3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:35Z,use_quota=True,user_id='d7af12c7402942118e3379237a151512',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cad0f41e-94e0-4247-a102-2cf1e04514ae),volume_type_id=cad0f41e-94e0-4247-a102-2cf1e04514ae)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Creating volume 235f06a2-560e-44e4-b246-e7c0534888bb {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:35 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:35 devstack sudo[95664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb 1073741824 Sep 07 13:49:35 devstack sudo[95664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:35 devstack sudo[95664]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb 1073741824" returned: 0 in 0.646s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:36 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb Sep 07 13:49:36 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:36 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-5c37d51d-d721-4c47-a44f-b5d8d88815f1 req-76c8c999-99e2-45d2-9886-9f76e18f6044 tempest-AttachVolumeTestJSON-959586247 None] Terminate volume connection completed successfully. Sep 07 13:49:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-5c37d51d-d721-4c47-a44f-b5d8d88815f1 req-76c8c999-99e2-45d2-9886-9f76e18f6044 tempest-AttachVolumeTestJSON-959586247 None] Deleting attachment 108784e2-bfc3-4780-90cd-0a346c42cd0b. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:49:36 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb" returned: 0 in 0.388s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (622dc832-f540-466c-86c7-868d43e8e60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-235f06a2-560e-44e4-b246-e7c0534888bb', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8506c9-dcdb-4c37-91fd-5a22fc1b0e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:36 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Volume volume-235f06a2-560e-44e4-b246-e7c0534888bb (235f06a2-560e-44e4-b246-e7c0534888bb): created successfully Sep 07 13:49:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8506c9-dcdb-4c37-91fd-5a22fc1b0e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Flow 'volume_create_manager' (c93ef8c3-86b9-481c-b1a8-d49cd1791023) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:36 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d214b69e-9371-46e7-82bb-5b1f903ff216 tempest-GroupSnapshotsTest-1713684335 None] Created volume successfully. Sep 07 13:49:38 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] GroupSnapshot 9d1d48f9-9ae6-424e-8cd5-2df2aa5b8b75: creating. Sep 07 13:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] Group snapshot 9d1d48f9-9ae6-424e-8cd5-2df2aa5b8b75: creating. {{(pid=87444) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 13:49:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] Creating offline snapshot b6c198dc-e4f3-488b-a300-c6f257b65447 of volume 235f06a2-560e-44e4-b246-e7c0534888bb {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:49:38 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa4915e-d756-411e-984c-1b810fdf577b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:38 devstack sudo[95788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb Sep 07 13:49:38 devstack sudo[95788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:39 devstack sudo[95788]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb" returned: 0 in 1.070s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:39 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447 1G Sep 07 13:49:39 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:40 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447 1G" returned: 0 in 0.898s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-235f06a2-560e-44e4-b246-e7c0534888bb -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:40 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-235f06a2-560e-44e4-b246-e7c0534888bb -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447 Sep 07 13:49:40 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Acquiring lock "cinder-f907319e-3648-4b8a-9b06-617ef08b7aee-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:41 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-235f06a2-560e-44e4-b246-e7c0534888bb -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447" returned: 0 in 0.783s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:41 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Lock "cinder-f907319e-3648-4b8a-9b06-617ef08b7aee-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:41 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447 Sep 07 13:49:41 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Acquiring lock "cinder-quobyte-f907319e-3648-4b8a-9b06-617ef08b7aee" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Lock "cinder-quobyte-f907319e-3648-4b8a-9b06-617ef08b7aee" acquired by "delete_volume" :: waited 0.053s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:41 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[617e0e55-171d-4dc2-acc0-6c5085c28d8f]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f907319e-3648-4b8a-9b06-617ef08b7aee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:41 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f907319e-3648-4b8a-9b06-617ef08b7aee Sep 07 13:49:41 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:41 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447" returned: 0 in 0.587s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:41 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.info Sep 07 13:49:41 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:42 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:42 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f907319e-3648-4b8a-9b06-617ef08b7aee" returned: 0 in 0.650s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.info" returned: 0 in 0.302s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f907319e-3648-4b8a-9b06-617ef08b7aee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:42 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:49:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:42 devstack sudo[95879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f907319e-3648-4b8a-9b06-617ef08b7aee Sep 07 13:49:42 devstack sudo[95879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:42 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.info Sep 07 13:49:42 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:42 devstack sudo[95879]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f907319e-3648-4b8a-9b06-617ef08b7aee" returned: 0 in 0.290s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Lock "cinder-quobyte-f907319e-3648-4b8a-9b06-617ef08b7aee" released by "delete_volume" :: held 1.035s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:42 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.info" returned: 0 in 0.318s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.159s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:42 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Created reservations ['d8d73320-e258-4f3d-9297-aa0aefc639da', '634bbb48-5384-413e-bb5e-874fd0c9f521', '7344393c-0bfc-4695-a6f0-f3644f8ecdc6', '241f593f-677e-4b1a-86de-c100b39a50d6'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dab77524-d431-4496-aa92-08fc77bd3c5a tempest-GroupSnapshotsTest-1713684335 None] group_snapshot 9d1d48f9-9ae6-424e-8cd5-2df2aa5b8b75: created successfully Sep 07 13:49:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:42 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:49:42 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] group_snapshot 9d1d48f9-9ae6-424e-8cd5-2df2aa5b8b75: deleting Sep 07 13:49:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] group_snapshot 9d1d48f9-9ae6-424e-8cd5-2df2aa5b8b75: deleting {{(pid=87444) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 13:49:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "cinder-quobyte-235f06a2-560e-44e4-b246-e7c0534888bb" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-235f06a2-560e-44e4-b246-e7c0534888bb" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "cinder-quobyte-b6c198dc-e4f3-488b-a300-c6f257b65447" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-b6c198dc-e4f3-488b-a300-c6f257b65447" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] Deleting offline snapshot b6c198dc-e4f3-488b-a300-c6f257b65447 of volume 235f06a2-560e-44e4-b246-e7c0534888bb {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:49:43 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] snapshot_file for this snap is: volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:49:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.630s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:43 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Deleted volume successfully. Sep 07 13:49:43 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[648a1a75-9875-4115-bec6-3c0d5a7f5f16]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f71f386d-26c5-4cad-814f-be99bd69f00d tempest-VolumesNegativeTest-1469807904 None] Lock "cinder-f907319e-3648-4b8a-9b06-617ef08b7aee-delete_volume" released by "delete_volume" :: held 2.257s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:43 devstack sudo[95889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447 Sep 07 13:49:43 devstack sudo[95889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:44 devstack sudo[95889]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447" returned: 0 in 0.493s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-235f06a2-560e-44e4-b246-e7c0534888bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:49:44 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e8501f-67df-4ac7-914a-813ef26c072e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "cinder-7d57c819-ddbd-4373-a9cb-129fe45e9574-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Lock "cinder-7d57c819-ddbd-4373-a9cb-129fe45e9574-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:44 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb Sep 07 13:49:44 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "cinder-quobyte-7d57c819-ddbd-4373-a9cb-129fe45e9574" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Lock "cinder-quobyte-7d57c819-ddbd-4373-a9cb-129fe45e9574" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:44 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6268446-afa2-4eb5-abab-3b07e1a744dc]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d57c819-ddbd-4373-a9cb-129fe45e9574 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:44 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d57c819-ddbd-4373-a9cb-129fe45e9574 Sep 07 13:49:44 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:44 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb" returned: 0 in 0.465s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:44 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447 Sep 07 13:49:44 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:44 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d57c819-ddbd-4373-a9cb-129fe45e9574" returned: 0 in 0.433s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d57c819-ddbd-4373-a9cb-129fe45e9574 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:44 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d57c819-ddbd-4373-a9cb-129fe45e9574 Sep 07 13:49:44 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:44 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447" returned: 0 in 0.426s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:44 devstack sudo[95912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447 Sep 07 13:49:44 devstack sudo[95912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:45 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7d57c819-ddbd-4373-a9cb-129fe45e9574" returned: 0 in 0.330s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Lock "cinder-quobyte-7d57c819-ddbd-4373-a9cb-129fe45e9574" released by "delete_volume" :: held 0.820s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Created reservations ['bb97b919-d344-462b-8915-1a49a535d71d', 'e58c9405-a601-4922-8ddc-6b717cd281e8', 'e5d38127-9e41-493c-9f2a-729bc677874d', '3ae019d7-94b4-4e14-9348-8e8511a1ce97'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:45 devstack sudo[95912]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb.b6c198dc-e4f3-488b-a300-c6f257b65447" returned: 0 in 0.302s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:45 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:49:45 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-b6c198dc-e4f3-488b-a300-c6f257b65447" released by "_delete_snapshot" :: held 1.945s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-235f06a2-560e-44e4-b246-e7c0534888bb" released by "delete_snapshot" :: held 1.999s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "cinder-c70a087e-baad-497d-b049-7664b49d4b1c-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Lock "cinder-c70a087e-baad-497d-b049-7664b49d4b1c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:45 devstack cinder-volume[87444]: WARNING cinder.quota [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1274367373 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1274367373, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:49:45 devstack cinder-volume[87444]: WARNING cinder.quota [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1274367373 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1274367373, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "cinder-quobyte-c70a087e-baad-497d-b049-7664b49d4b1c" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] Created reservations ['251bd631-d33b-4b6d-afba-182fe05b06d5', 'ca297dcb-d1e5-4e75-ae53-fd86582f2ed5', 'ea035274-6b9e-4d9a-a4f0-175343087957', 'd0e83aac-276d-4856-8ae0-c803d588fea0'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Lock "cinder-quobyte-c70a087e-baad-497d-b049-7664b49d4b1c" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7427daa4-4942-4df8-b114-77ab7268dc76]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c70a087e-baad-497d-b049-7664b49d4b1c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ea7597d5-9b4d-4b74-8b93-e29bb2567df5 tempest-GroupSnapshotsTest-1713684335 None] group_snapshot 9d1d48f9-9ae6-424e-8cd5-2df2aa5b8b75: deleted successfully Sep 07 13:49:45 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.518s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Deleted volume successfully. Sep 07 13:49:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5921e27-cd85-413e-9a81-693dca10b2c1 tempest-AttachVolumeTestJSON-959586247 None] Lock "cinder-7d57c819-ddbd-4373-a9cb-129fe45e9574-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:45 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c70a087e-baad-497d-b049-7664b49d4b1c Sep 07 13:49:45 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c70a087e-baad-497d-b049-7664b49d4b1c" returned: 0 in 0.560s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c70a087e-baad-497d-b049-7664b49d4b1c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:46 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:46 devstack sudo[95924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c70a087e-baad-497d-b049-7664b49d4b1c Sep 07 13:49:46 devstack sudo[95924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "cinder-quobyte-235f06a2-560e-44e4-b246-e7c0534888bb" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-235f06a2-560e-44e4-b246-e7c0534888bb" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[56eb4ef3-3e0c-4e3c-b1a3-3115325c5bfd]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:46 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb Sep 07 13:49:46 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:46 devstack sudo[95924]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c70a087e-baad-497d-b049-7664b49d4b1c" returned: 0 in 0.384s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Lock "cinder-quobyte-c70a087e-baad-497d-b049-7664b49d4b1c" released by "delete_volume" :: held 1.026s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Created reservations ['41fbf9d0-db96-4a46-8378-a9076fc70e53', '41fbb905-f79e-4c56-a350-e25f56566ba3', 'de01b605-8635-4bd2-ad5c-5e8bd2127428', '9841c3be-8d44-4816-aa52-b6818513aae2'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:46 devstack sudo[95933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:49:46 devstack sudo[95933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:46 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb" returned: 0 in 0.533s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:46 devstack sudo[95935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb Sep 07 13:49:46 devstack sudo[95935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:47 devstack sudo[95933]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.349s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Deleted volume successfully. Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d6a89416-d70b-41b8-8685-cdf17e7f36c5 tempest-AttachVolumeTestJSON-959586247 None] Lock "cinder-c70a087e-baad-497d-b049-7664b49d4b1c-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:47 devstack sudo[95935]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-235f06a2-560e-44e4-b246-e7c0534888bb" returned: 0 in 0.377s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] Lock "cinder-quobyte-235f06a2-560e-44e4-b246-e7c0534888bb" released by "delete_volume" :: held 0.991s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] Created reservations ['d3a550be-1ca4-410f-ad15-965ff6c3ae8c'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:47 devstack cinder-volume[87444]: WARNING cinder.quota [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1274367373 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1274367373, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] Created reservations ['2bab4085-4e4f-4bc0-8104-45a414e53cf0', '09f27b5f-08c5-4ae5-9c13-641799ad3840', 'a1121a16-1f30-4db4-bb25-cf6b9118782a', '2f487fff-cabe-4c2b-981d-43a2f84fd840'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:47 devstack sudo[95939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:49:47 devstack sudo[95939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "cinder-cfc43d1e-d113-42e4-8030-352edb596660-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Lock "cinder-cfc43d1e-d113-42e4-8030-352edb596660-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:47 devstack sudo[95939]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.411s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:47 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-199849e1-89da-46e6-b00a-bfe5997d18c5 tempest-GroupSnapshotsTest-1713684335 None] Delete group completed successfully. Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "cinder-quobyte-cfc43d1e-d113-42e4-8030-352edb596660" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Lock "cinder-quobyte-cfc43d1e-d113-42e4-8030-352edb596660" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39237eb-58a1-496f-ab42-84564a286d18]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cfc43d1e-d113-42e4-8030-352edb596660 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:48 devstack sudo[95942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cfc43d1e-d113-42e4-8030-352edb596660 Sep 07 13:49:48 devstack sudo[95942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Flow 'volume_create_manager' (c280d1b7-d372-4858-9687-635a23e59327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e963ac1-7e71-42ba-b649-39a094028eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e963ac1-7e71-42ba-b649-39a094028eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-49006910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5840bfb3-74c0-4a10-96f2-f627e51bbf97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea433fcc60042eb993c7e479c936278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:48Z,use_quota=True,user_id='53d22da7743644f98aa10c7f3f9d1b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75e0395-9566-404e-ae3f-8e63b0ab6f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75e0395-9566-404e-ae3f-8e63b0ab6f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de4cb1d-8251-42c7-9e74-970ad47749a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1de4cb1d-8251-42c7-9e74-970ad47749a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5840bfb3-74c0-4a10-96f2-f627e51bbf97', 'volume_name': 'volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a2cb14-21ff-4fc4-bf36-3d6780e34b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65a2cb14-21ff-4fc4-bf36-3d6780e34b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd797ddf-4f60-414f-a769-14c6d577a0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:48 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Volume 5840bfb3-74c0-4a10-96f2-f627e51bbf97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97', 'volume_size': 1} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:49:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-49006910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5840bfb3-74c0-4a10-96f2-f627e51bbf97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eea433fcc60042eb993c7e479c936278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:49:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:49:48Z,use_quota=True,user_id='53d22da7743644f98aa10c7f3f9d1b55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Creating volume 5840bfb3-74c0-4a10-96f2-f627e51bbf97 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:49:48 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:48 devstack sudo[95942]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:48 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 1073741824 Sep 07 13:49:48 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cfc43d1e-d113-42e4-8030-352edb596660" returned: 0 in 0.483s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cfc43d1e-d113-42e4-8030-352edb596660 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:48 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cfc43d1e-d113-42e4-8030-352edb596660 Sep 07 13:49:48 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:48 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cfc43d1e-d113-42e4-8030-352edb596660" returned: 0 in 0.405s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Lock "cinder-quobyte-cfc43d1e-d113-42e4-8030-352edb596660" released by "delete_volume" :: held 0.944s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Created reservations ['cd4d31e1-fc3c-42c9-a1df-68ff1f1b554f', '9f4f5041-e52a-4c55-b83f-2d8bfa87bfbc', 'c31f9972-b51c-474e-ac11-079cc0bba333', '99560fbd-b9b5-4fde-b67e-a0e78cae16cf'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:49:49 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 1073741824" returned: 0 in 0.623s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:49 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 Sep 07 13:49:49 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:49 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:49:49 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:49 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97" returned: 0 in 0.309s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd797ddf-4f60-414f-a769-14c6d577a0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce3b184-8964-41a4-83ba-82e33298632d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:49:49 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Volume volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 (5840bfb3-74c0-4a10-96f2-f627e51bbf97): created successfully Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce3b184-8964-41a4-83ba-82e33298632d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Flow 'volume_create_manager' (c280d1b7-d372-4858-9687-635a23e59327) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:49:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dd8525a4-082f-4f5b-960c-57b66907b20b tempest-VolumesSnapshotListTestJSON-157886980 None] Created volume successfully. Sep 07 13:49:49 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.386s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:49:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Deleted volume successfully. Sep 07 13:49:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f912d9ed-c155-49f9-8f67-eb7de0f935c5 tempest-AttachVolumeTestJSON-959586247 None] Lock "cinder-cfc43d1e-d113-42e4-8030-352edb596660-delete_volume" released by "delete_volume" :: held 1.705s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:49:50 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=160,cinder:INSERT=40,cinder:UPDATE=178,cinder:DELETE=12 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:49:50 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=186,cinder:SELECT=171,cinder:INSERT=43,cinder:DELETE=6 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:49:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] Creating offline snapshot cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 of volume 5840bfb3-74c0-4a10-96f2-f627e51bbf97 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:49:50 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3a35ae-9ce5-43ad-8f22-60d93825b587]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:51 devstack sudo[95964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 Sep 07 13:49:51 devstack sudo[95964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:51 devstack sudo[95964]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97" returned: 0 in 0.443s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:51 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 1G Sep 07 13:49:51 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:52 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 1G" returned: 0 in 0.633s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:52 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 Sep 07 13:49:52 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:52 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604" returned: 0 in 0.385s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:52 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 is being set with open permissions: ugo+rw Sep 07 13:49:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:52 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 Sep 07 13:49:52 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:52 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604" returned: 0 in 0.405s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:52 devstack sudo[95985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.info Sep 07 13:49:52 devstack sudo[95985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:53 devstack sudo[95985]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.info" returned: 0 in 0.433s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:53 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.info is being set with open permissions: ugo+rw Sep 07 13:49:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:53 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.info Sep 07 13:49:53 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:53 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.info" returned: 0 in 0.337s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.779s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-936a50a9-0714-4864-ae93-8dcf710e0ece tempest-VolumesSnapshotListTestJSON-157886980 None] Create snapshot completed successfully Sep 07 13:49:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-73c2e9fb-ab01-40bc-83db-150fede80f43 tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-73c2e9fb-ab01-40bc-83db-150fede80f43 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-73c2e9fb-ab01-40bc-83db-150fede80f43 tempest-VolumesSnapshotListTestJSON-157886980 None] Creating offline snapshot 3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 of volume 5840bfb3-74c0-4a10-96f2-f627e51bbf97 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:49:54 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d562cf91-1065-432b-9bd9-8fb915821b42]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-73c2e9fb-ab01-40bc-83db-150fede80f43 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:54 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 Sep 07 13:49:54 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:54 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-73c2e9fb-ab01-40bc-83db-150fede80f43 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604" returned: 0 in 0.402s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-73c2e9fb-ab01-40bc-83db-150fede80f43 tempest-VolumesSnapshotListTestJSON-157886980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:49:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-73c2e9fb-ab01-40bc-83db-150fede80f43 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:54 devstack sudo[96010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 1G Sep 07 13:49:54 devstack sudo[96010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:55 devstack sudo[96010]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-73c2e9fb-ab01-40bc-83db-150fede80f43 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 1G" returned: 0 in 0.522s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-73c2e9fb-ab01-40bc-83db-150fede80f43 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:55 devstack sudo[96016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 Sep 07 13:49:55 devstack sudo[96016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:55 devstack sudo[96016]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-73c2e9fb-ab01-40bc-83db-150fede80f43 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44" returned: 0 in 0.345s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:55 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-73c2e9fb-ab01-40bc-83db-150fede80f43 tempest-VolumesSnapshotListTestJSON-157886980 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 is being set with open permissions: ugo+rw Sep 07 13:49:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-73c2e9fb-ab01-40bc-83db-150fede80f43 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:55 devstack sudo[96021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 Sep 07 13:49:55 devstack sudo[96021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:55 devstack sudo[96021]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-73c2e9fb-ab01-40bc-83db-150fede80f43 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44" returned: 0 in 0.341s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-73c2e9fb-ab01-40bc-83db-150fede80f43 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.727s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:56 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-73c2e9fb-ab01-40bc-83db-150fede80f43 tempest-VolumesSnapshotListTestJSON-157886980 None] Create snapshot completed successfully Sep 07 13:49:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d908ca2-eead-43f9-9f13-5ea42a691ec3 tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:49:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d908ca2-eead-43f9-9f13-5ea42a691ec3 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:49:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2d908ca2-eead-43f9-9f13-5ea42a691ec3 tempest-VolumesSnapshotListTestJSON-157886980 None] Creating offline snapshot ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 of volume 5840bfb3-74c0-4a10-96f2-f627e51bbf97 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:49:56 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2e9fe3-c31f-450e-8904-0849df93c901]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:49:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d908ca2-eead-43f9-9f13-5ea42a691ec3 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:56 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 Sep 07 13:49:56 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:57 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d908ca2-eead-43f9-9f13-5ea42a691ec3 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44" returned: 0 in 0.578s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2d908ca2-eead-43f9-9f13-5ea42a691ec3 tempest-VolumesSnapshotListTestJSON-157886980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:49:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d908ca2-eead-43f9-9f13-5ea42a691ec3 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:57 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 1G Sep 07 13:49:57 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:57 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d908ca2-eead-43f9-9f13-5ea42a691ec3 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 1G" returned: 0 in 0.595s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d908ca2-eead-43f9-9f13-5ea42a691ec3 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:57 devstack sudo[96042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 Sep 07 13:49:57 devstack sudo[96042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:58 devstack sudo[96042]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d908ca2-eead-43f9-9f13-5ea42a691ec3 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15" returned: 0 in 0.401s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:58 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-2d908ca2-eead-43f9-9f13-5ea42a691ec3 tempest-VolumesSnapshotListTestJSON-157886980 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 is being set with open permissions: ugo+rw Sep 07 13:49:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d908ca2-eead-43f9-9f13-5ea42a691ec3 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:49:58 devstack sudo[96047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 Sep 07 13:49:58 devstack sudo[96047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:49:58 devstack sudo[96047]: pam_unix(sudo:session): session closed for user root Sep 07 13:49:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d908ca2-eead-43f9-9f13-5ea42a691ec3 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15" returned: 0 in 0.312s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:49:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d908ca2-eead-43f9-9f13-5ea42a691ec3 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.058s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:49:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2d908ca2-eead-43f9-9f13-5ea42a691ec3 tempest-VolumesSnapshotListTestJSON-157886980 None] Create snapshot completed successfully Sep 07 13:50:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "cinder-ccec504e-6b7b-4cc0-9592-d02c4f2e1b15-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-ccec504e-6b7b-4cc0-9592-d02c4f2e1b15-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "cinder-quobyte-5840bfb3-74c0-4a10-96f2-f627e51bbf97" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-quobyte-5840bfb3-74c0-4a10-96f2-f627e51bbf97" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "cinder-quobyte-ccec504e-6b7b-4cc0-9592-d02c4f2e1b15" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-quobyte-ccec504e-6b7b-4cc0-9592-d02c4f2e1b15" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Deleting offline snapshot ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 of volume 5840bfb3-74c0-4a10-96f2-f627e51bbf97 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:50:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] snapshot_file for this snap is: volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:50:01 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ef22dc-a1a5-4c58-9f5a-d1e80f267827]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:01 devstack sudo[96050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 Sep 07 13:50:01 devstack sudo[96050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:01 devstack sudo[96050]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15" returned: 0 in 0.571s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:50:01 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b98b00bc-8cd1-4aa7-ab67-d5244d96efd0]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:01 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 Sep 07 13:50:01 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:02 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44" returned: 0 in 0.460s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:50:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:02 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 Sep 07 13:50:02 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:02 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15" returned: 0 in 0.485s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:02 devstack sudo[96068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15 Sep 07 13:50:02 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:03 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.ccec504e-6b7b-4cc0-9592-d02c4f2e1b15" returned: 0 in 0.301s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-quobyte-ccec504e-6b7b-4cc0-9592-d02c4f2e1b15" released by "_delete_snapshot" :: held 2.001s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-quobyte-5840bfb3-74c0-4a10-96f2-f627e51bbf97" released by "delete_snapshot" :: held 2.037s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:03 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Created reservations ['85adbcb3-16c7-4c93-a640-1dc5fc978926', '2f8a9285-78ca-4836-9abd-d598b1cd0720', '9e62b6d6-b7a0-4226-a054-ea92159ee7a1', '9b7c19a3-26fc-47ab-af2c-23cf04a32571'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:03 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Delete snapshot completed successfully. Sep 07 13:50:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-56b4f987-3e6f-4d83-9b02-be4d34318a58 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-ccec504e-6b7b-4cc0-9592-d02c4f2e1b15-delete_snapshot" released by "delete_snapshot" :: held 2.311s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8dc0d9f4-9eee-485b-94f7-2216fcf50b20 tempest-GroupsV314Test-751084389 None] Group tempest-GroupsV314Test-Group-1245840653: creating Sep 07 13:50:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "cinder-3e2cc4bb-2cbb-44d0-88cf-27b618f20a44-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8dc0d9f4-9eee-485b-94f7-2216fcf50b20 tempest-GroupsV314Test-751084389 None] Group tempest-GroupsV314Test-Group-1245840653: created successfully Sep 07 13:50:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-3e2cc4bb-2cbb-44d0-88cf-27b618f20a44-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "cinder-quobyte-5840bfb3-74c0-4a10-96f2-f627e51bbf97" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8dc0d9f4-9eee-485b-94f7-2216fcf50b20 tempest-GroupsV314Test-751084389 None] Create group completed successfully. Sep 07 13:50:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-quobyte-5840bfb3-74c0-4a10-96f2-f627e51bbf97" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "cinder-quobyte-3e2cc4bb-2cbb-44d0-88cf-27b618f20a44" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-quobyte-3e2cc4bb-2cbb-44d0-88cf-27b618f20a44" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Deleting offline snapshot 3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 of volume 5840bfb3-74c0-4a10-96f2-f627e51bbf97 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] snapshot_file for this snap is: volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:50:04 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7617ad0-79a6-4d0b-a016-f8c4c1bc923f]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:04 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 Sep 07 13:50:04 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:05 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44" returned: 0 in 0.595s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:50:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccc240e-258d-4838-8c52-0003f8256dc7]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:05 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 Sep 07 13:50:05 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:05 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604" returned: 0 in 0.520s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:50:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:05 devstack sudo[96112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 Sep 07 13:50:05 devstack sudo[96112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:50:06 devstack sudo[96112]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Flow 'volume_create_manager' (4e797993-ea69-43f5-bc13-b87f14ff309c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11bf5c97-015b-473b-981f-d3005543ad48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44" returned: 0 in 0.685s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11bf5c97-015b-473b-981f-d3005543ad48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1924594196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83ead30b-6711-4114-88e0-84c1b6612dcb,host='devstack@QuobyteHD#QuobyteHD',id=b6161e5a-ee22-4e7a-b1ab-e5da0408b632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adce185d1f8d48f49bb7ee540dd8bf0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:06Z,use_quota=True,user_id='f3ab96b9069046de90f93b5e6f1be7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90926129-36fd-4915-abcc-6a6a31df6731),volume_type_id=90926129-36fd-4915-abcc-6a6a31df6731)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c490f79-0ac8-41ea-ab79-9a2eb93af43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c490f79-0ac8-41ea-ab79-9a2eb93af43f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:06 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44 Sep 07 13:50:06 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e34fcc-6f67-40df-a6d6-aebadd106914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e34fcc-6f67-40df-a6d6-aebadd106914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6161e5a-ee22-4e7a-b1ab-e5da0408b632', 'volume_name': 'volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64dfdba2-7e1d-44c5-8a07-f52877253dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64dfdba2-7e1d-44c5-8a07-f52877253dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2039861b-9614-4759-90e4-a4d0e7bb2f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:06 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Volume b6161e5a-ee22-4e7a-b1ab-e5da0408b632: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632', 'volume_size': 1} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=83ead30b-6711-4114-88e0-84c1b6612dcb,created_at=2026-09-07T11:50:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1924594196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=83ead30b-6711-4114-88e0-84c1b6612dcb,host='devstack@QuobyteHD#QuobyteHD',id=b6161e5a-ee22-4e7a-b1ab-e5da0408b632,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='adce185d1f8d48f49bb7ee540dd8bf0d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:06Z,use_quota=True,user_id='f3ab96b9069046de90f93b5e6f1be7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90926129-36fd-4915-abcc-6a6a31df6731),volume_type_id=90926129-36fd-4915-abcc-6a6a31df6731)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Creating volume b6161e5a-ee22-4e7a-b1ab-e5da0408b632 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:50:06 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:06 devstack sudo[96121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 1073741824 Sep 07 13:50:06 devstack sudo[96121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:06 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.3e2cc4bb-2cbb-44d0-88cf-27b618f20a44" returned: 0 in 0.453s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-quobyte-3e2cc4bb-2cbb-44d0-88cf-27b618f20a44" released by "_delete_snapshot" :: held 2.427s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-quobyte-5840bfb3-74c0-4a10-96f2-f627e51bbf97" released by "delete_snapshot" :: held 2.467s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Created reservations ['45fd2811-5770-408a-88ff-9801f6375205', 'c1eda5e4-f29f-409f-ae5a-e009e76e6947', 'fe67655f-5b2b-4deb-9078-95ccb5172ebf', 'babeb57e-3688-4f3d-910c-9aa06ff5b827'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Delete snapshot completed successfully. Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8624e10f-18be-4a8f-a771-683bc0c247e0 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-3e2cc4bb-2cbb-44d0-88cf-27b618f20a44-delete_snapshot" released by "delete_snapshot" :: held 2.735s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:07 devstack sudo[96121]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 1073741824" returned: 0 in 0.712s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:07 devstack sudo[96128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 Sep 07 13:50:07 devstack sudo[96128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:07 devstack sudo[96128]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632" returned: 0 in 0.297s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2039861b-9614-4759-90e4-a4d0e7bb2f79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace9697c-db05-4438-9bde-a51aa5978cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:07 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Volume volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 (b6161e5a-ee22-4e7a-b1ab-e5da0408b632): created successfully Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ace9697c-db05-4438-9bde-a51aa5978cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Flow 'volume_create_manager' (4e797993-ea69-43f5-bc13-b87f14ff309c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-19d7de76-8de3-413b-a93f-a8c5a3df6cde tempest-GroupsV314Test-751084389 None] Created volume successfully. Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "cinder-cb2c55b8-79c3-49f3-b1ef-d0978fdfa604-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-cb2c55b8-79c3-49f3-b1ef-d0978fdfa604-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "cinder-quobyte-5840bfb3-74c0-4a10-96f2-f627e51bbf97" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-quobyte-5840bfb3-74c0-4a10-96f2-f627e51bbf97" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "cinder-quobyte-cb2c55b8-79c3-49f3-b1ef-d0978fdfa604" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-quobyte-cb2c55b8-79c3-49f3-b1ef-d0978fdfa604" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Deleting offline snapshot cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 of volume 5840bfb3-74c0-4a10-96f2-f627e51bbf97 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] snapshot_file for this snap is: volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b236925e-0bf6-4835-bf80-706358f74767]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:07 devstack sudo[96131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 Sep 07 13:50:07 devstack sudo[96131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e8f134fd-edc0-4efb-b065-ecdbee6ed70c tempest-BackendsCapabilitiesAdminTestsJSON-1043881838 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5802955627441, 'free_capacity_gb': 1773.5802955627441, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87444) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 13:50:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-92aa2afc-c05c-4900-a0ba-f0b8c341387c tempest-BackendsCapabilitiesAdminTestsJSON-1043881838 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5802955627441, 'free_capacity_gb': 1773.5802955627441, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87444) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 13:50:08 devstack sudo[96131]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604" returned: 0 in 0.452s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:50:08 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[90626f40-846f-4db2-9176-2d6982622bb1]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:08 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 Sep 07 13:50:08 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:08 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97" returned: 0 in 0.476s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:08 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 Sep 07 13:50:08 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Acquiring lock "cinder-fe27bc94-373e-47d5-a16b-52426b7b55f4-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Lock "cinder-fe27bc94-373e-47d5-a16b-52426b7b55f4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Acquiring lock "cinder-quobyte-fe27bc94-373e-47d5-a16b-52426b7b55f4" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Lock "cinder-quobyte-fe27bc94-373e-47d5-a16b-52426b7b55f4" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[adce56cd-a892-4dd5-a5b1-e071e0ac9721]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe27bc94-373e-47d5-a16b-52426b7b55f4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:09 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604" returned: 0 in 0.499s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:09 devstack sudo[96147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604 Sep 07 13:50:09 devstack sudo[96147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:09 devstack sudo[96146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe27bc94-373e-47d5-a16b-52426b7b55f4 Sep 07 13:50:09 devstack sudo[96146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:09 devstack sudo[96147]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97.cb2c55b8-79c3-49f3-b1ef-d0978fdfa604" returned: 0 in 0.359s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:09 devstack sudo[96146]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe27bc94-373e-47d5-a16b-52426b7b55f4" returned: 0 in 0.446s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe27bc94-373e-47d5-a16b-52426b7b55f4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-quobyte-cb2c55b8-79c3-49f3-b1ef-d0978fdfa604" released by "_delete_snapshot" :: held 1.949s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-quobyte-5840bfb3-74c0-4a10-96f2-f627e51bbf97" released by "delete_snapshot" :: held 1.980s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:09 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe27bc94-373e-47d5-a16b-52426b7b55f4 Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:09 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Cloning volume b6161e5a-ee22-4e7a-b1ab-e5da0408b632 to volume 84262168-3bfd-443e-83ae-e00549af8ed1 Sep 07 13:50:09 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Created reservations ['54a86c4b-08fd-4039-8f42-a8286d1c5df9', '213a9419-5a53-4df3-bb1a-77f10169d5f1', '28ce0e48-8bb6-49c3-a28e-a844363166b2', '6ba517f5-eb30-4d3d-9791-bd8aa2e786d5'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Creating offline snapshot f7f67dd7-916e-4029-add6-e3ed16c9cb8e of volume b6161e5a-ee22-4e7a-b1ab-e5da0408b632 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c04d9d-6a2a-4bf2-9fe6-06e2f3a9b493]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Delete snapshot completed successfully. Sep 07 13:50:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6be368e4-a4f6-4132-94c6-3e561f901878 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-cb2c55b8-79c3-49f3-b1ef-d0978fdfa604-delete_snapshot" released by "delete_snapshot" :: held 2.253s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:10 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 Sep 07 13:50:10 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:10 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe27bc94-373e-47d5-a16b-52426b7b55f4" returned: 0 in 0.409s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Lock "cinder-quobyte-fe27bc94-373e-47d5-a16b-52426b7b55f4" released by "delete_volume" :: held 0.909s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:10 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Created reservations ['0bc24e0b-9dab-4199-8e46-9858d4b3c2f5', '55274e75-3ff3-43fe-a0c8-34183e88e522', 'f2f9d263-f358-470c-998b-f38c9b751874', '05704775-2510-4d01-8ca0-2f78a12a3275'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:10 devstack sudo[96161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:50:10 devstack sudo[96161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:10 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632" returned: 0 in 0.552s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:10 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e 1G Sep 07 13:50:10 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:10 devstack sudo[96161]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.333s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:10 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Deleted volume successfully. Sep 07 13:50:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7f36fd07-40c6-4baa-a91b-6d37873c6294 tempest-AttachVolumeShelveTestJSON-1571689035 None] Lock "cinder-fe27bc94-373e-47d5-a16b-52426b7b55f4-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:11 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e 1G" returned: 0 in 0.609s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "cinder-5840bfb3-74c0-4a10-96f2-f627e51bbf97-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:11 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e Sep 07 13:50:11 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-5840bfb3-74c0-4a10-96f2-f627e51bbf97-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "cinder-quobyte-5840bfb3-74c0-4a10-96f2-f627e51bbf97" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-quobyte-5840bfb3-74c0-4a10-96f2-f627e51bbf97" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:11 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[af15d0f1-afe8-45de-a2ee-3f23104e7b27]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:11 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 Sep 07 13:50:11 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:11 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e" returned: 0 in 0.451s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:11 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:50:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:11 devstack sudo[96179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e Sep 07 13:50:11 devstack sudo[96179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:11 devstack sudo[96179]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:11 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e" returned: 0 in 0.394s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97" returned: 0 in 0.607s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:11 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97 Sep 07 13:50:11 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:12 devstack sudo[96188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.info Sep 07 13:50:12 devstack sudo[96188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:12 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5840bfb3-74c0-4a10-96f2-f627e51bbf97" returned: 0 in 0.349s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-quobyte-5840bfb3-74c0-4a10-96f2-f627e51bbf97" released by "delete_volume" :: held 1.070s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Created reservations ['f7ad7516-aa35-4780-aff4-471f68b7eba7', '4f78d52c-f149-4307-83d0-4a8341162eee', '21696adf-3f90-423d-914c-946339d8f5ba', '84f1b44d-42a8-49d7-a6a4-1aff3f111a51'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:12 devstack sudo[96188]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.info" returned: 0 in 0.420s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:12 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:12 devstack sudo[96193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.info Sep 07 13:50:12 devstack sudo[96193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:12 devstack sudo[96195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:50:12 devstack sudo[96195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:12 devstack sudo[96193]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.info" returned: 0 in 0.440s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Acquiring lock "cinder-quobyte-84262168-3bfd-443e-83ae-e00549af8ed1" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:12 devstack sudo[96195]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Lock "cinder-quobyte-84262168-3bfd-443e-83ae-e00549af8ed1" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] snapshot: f7f67dd7-916e-4029-add6-e3ed16c9cb8e, volume: 84262168-3bfd-443e-83ae-e00549af8ed1, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.440s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Deleted volume successfully. Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[693b0115-355e-4e5e-aecb-9359dc0a90dd]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5a6e4045-18de-4cd1-9f25-d99224e49843 tempest-VolumesSnapshotListTestJSON-157886980 None] Lock "cinder-5840bfb3-74c0-4a10-96f2-f627e51bbf97-delete_volume" released by "delete_volume" :: held 1.913s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:13 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e Sep 07 13:50:13 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:13 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e" returned: 0 in 0.429s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:50:13 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6474356-62a4-43e4-8132-0890eeaa8005]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:13 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 Sep 07 13:50:13 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:13 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632" returned: 0 in 0.554s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] will copy from snapshot at /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:50:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:50:13 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Path /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-84262168-3bfd-443e-83ae-e00549af8ed1 not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:50:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-84262168-3bfd-443e-83ae-e00549af8ed1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:14 devstack sudo[96212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-84262168-3bfd-443e-83ae-e00549af8ed1 Sep 07 13:50:14 devstack sudo[96212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:20 devstack sudo[96212]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-84262168-3bfd-443e-83ae-e00549af8ed1" returned: 0 in 6.591s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:20 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Image conversion details: src /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632, size 1024.00 MB, duration 6.59 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-84262168-3bfd-443e-83ae-e00549af8ed1 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:50:20 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Converted 1024.00 MB image at 155.29 MB/s Sep 07 13:50:20 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-84262168-3bfd-443e-83ae-e00549af8ed1 is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:50:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-84262168-3bfd-443e-83ae-e00549af8ed1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:20 devstack sudo[96226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-84262168-3bfd-443e-83ae-e00549af8ed1 Sep 07 13:50:20 devstack sudo[96226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5f7103ee-9613-4abe-9dad-4bc18144f2ce tempest-GroupSnapshotsV319Test-574805829 None] Group tempest-GroupSnapshotsV319Test-Group-681953140: creating Sep 07 13:50:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5f7103ee-9613-4abe-9dad-4bc18144f2ce tempest-GroupSnapshotsV319Test-574805829 None] Group tempest-GroupSnapshotsV319Test-Group-681953140: created successfully Sep 07 13:50:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5f7103ee-9613-4abe-9dad-4bc18144f2ce tempest-GroupSnapshotsV319Test-574805829 None] Create group completed successfully. Sep 07 13:50:20 devstack sudo[96226]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-84262168-3bfd-443e-83ae-e00549af8ed1" returned: 0 in 0.425s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Lock "cinder-quobyte-84262168-3bfd-443e-83ae-e00549af8ed1" released by "_copy_volume_from_snapshot" :: held 8.111s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Acquiring lock "cinder-quobyte-f7f67dd7-916e-4029-add6-e3ed16c9cb8e" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Lock "cinder-quobyte-f7f67dd7-916e-4029-add6-e3ed16c9cb8e" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Deleting offline snapshot f7f67dd7-916e-4029-add6-e3ed16c9cb8e of volume b6161e5a-ee22-4e7a-b1ab-e5da0408b632 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:50:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] snapshot_file for this snap is: volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:50:21 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[da41473b-4814-4301-a234-15ff82df86c1]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:21 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e Sep 07 13:50:21 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:21 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e" returned: 0 in 0.443s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:50:21 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[189d724f-bf4f-4ffe-847b-5691b452fa5f]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:21 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 Sep 07 13:50:21 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:22 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632" returned: 0 in 0.666s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:22 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e Sep 07 13:50:22 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:22 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:50:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Flow 'volume_create_manager' (37a16151-26fa-4d66-a5b2-bfa496488f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5caf9367-8217-42e6-b3be-1d66d28731f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5caf9367-8217-42e6-b3be-1d66d28731f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1311729035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=330fa018-305d-4d09-afc8-22a93978a2cd,host='devstack@QuobyteHD#QuobyteHD',id=9a068c27-dc66-4ad1-82d9-4884f7b6b629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0571ece3cf8c482493a9354eea9d50ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:23Z,use_quota=True,user_id='7dc82aef23d54aadad4cfd3784d7a629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1c273a3-76cc-4227-bee5-ca54dda8c295),volume_type_id=d1c273a3-76cc-4227-bee5-ca54dda8c295)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:23 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537538c8-a376-40c6-a1db-67e35b1f8e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (537538c8-a376-40c6-a1db-67e35b1f8e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82813fd3-6de1-41c7-9cc1-b4255c9fa676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82813fd3-6de1-41c7-9cc1-b4255c9fa676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a068c27-dc66-4ad1-82d9-4884f7b6b629', 'volume_name': 'volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778614eb-8ba4-4e4f-8719-ba200feaa663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (778614eb-8ba4-4e4f-8719-ba200feaa663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbf06887-50e9-476f-a823-a7a046483268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:23 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Volume 9a068c27-dc66-4ad1-82d9-4884f7b6b629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629', 'volume_size': 1} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e" returned: 0 in 0.813s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:23 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e Sep 07 13:50:23 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:23 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632.f7f67dd7-916e-4029-add6-e3ed16c9cb8e" returned: 0 in 0.309s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Lock "cinder-quobyte-f7f67dd7-916e-4029-add6-e3ed16c9cb8e" released by "_delete_snapshot" :: held 2.368s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.711s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.380s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=330fa018-305d-4d09-afc8-22a93978a2cd,created_at=2026-09-07T11:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1311729035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=330fa018-305d-4d09-afc8-22a93978a2cd,host='devstack@QuobyteHD#QuobyteHD',id=9a068c27-dc66-4ad1-82d9-4884f7b6b629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0571ece3cf8c482493a9354eea9d50ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:23Z,use_quota=True,user_id='7dc82aef23d54aadad4cfd3784d7a629',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1c273a3-76cc-4227-bee5-ca54dda8c295),volume_type_id=d1c273a3-76cc-4227-bee5-ca54dda8c295)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Creating volume 9a068c27-dc66-4ad1-82d9-4884f7b6b629 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:50:23 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:50:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:23 devstack sudo[96249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 1073741824 Sep 07 13:50:23 devstack sudo[96249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:23 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fe053a05-c7a0-4c11-b969-fb8040fb1987 tempest-GroupsV314Test-751084389 None] Create group from source-group-83ead30b-6711-4114-88e0-84c1b6612dcb completed successfully. Sep 07 13:50:24 devstack sudo[96249]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 1073741824" returned: 0 in 0.699s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:24 devstack sudo[96256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 Sep 07 13:50:24 devstack sudo[96256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:24 devstack sudo[96256]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629" returned: 0 in 0.328s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:50:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbf06887-50e9-476f-a823-a7a046483268) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4141519-ae92-4b4f-810d-1d0d18ff638e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Acquiring lock "cinder-quobyte-84262168-3bfd-443e-83ae-e00549af8ed1" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:24 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Volume volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 (9a068c27-dc66-4ad1-82d9-4884f7b6b629): created successfully Sep 07 13:50:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4141519-ae92-4b4f-810d-1d0d18ff638e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Flow 'volume_create_manager' (37a16151-26fa-4d66-a5b2-bfa496488f0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Lock "cinder-quobyte-84262168-3bfd-443e-83ae-e00549af8ed1" acquired by "delete_volume" :: waited 0.047s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d3a6c268-7e49-4e68-9c6a-03c0aa00928a tempest-GroupSnapshotsV319Test-574805829 None] Created volume successfully. Sep 07 13:50:24 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[88674f86-6229-49eb-ab73-d073e4417824]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-84262168-3bfd-443e-83ae-e00549af8ed1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:24 devstack sudo[96259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-84262168-3bfd-443e-83ae-e00549af8ed1 Sep 07 13:50:24 devstack sudo[96259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:25 devstack sudo[96259]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-84262168-3bfd-443e-83ae-e00549af8ed1" returned: 0 in 0.465s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-84262168-3bfd-443e-83ae-e00549af8ed1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:25 devstack sudo[96264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-84262168-3bfd-443e-83ae-e00549af8ed1 Sep 07 13:50:25 devstack sudo[96264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:25 devstack sudo[96264]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-84262168-3bfd-443e-83ae-e00549af8ed1" returned: 0 in 0.308s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Lock "cinder-quobyte-84262168-3bfd-443e-83ae-e00549af8ed1" released by "delete_volume" :: held 0.846s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:25 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Created reservations ['410fbfe0-b9e7-4a84-912e-92865f358727'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:25 devstack cinder-volume[87444]: WARNING cinder.quota [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1600897621 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1600897621, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:50:25 devstack cinder-volume[87444]: WARNING cinder.quota [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1600897621 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1600897621, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:50:25 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Created reservations ['042336b0-2d64-4f49-b809-0f0bf68e83b6', 'b00dd085-411c-4690-b054-2c6d81c5dbc0', '88b07716-575f-4f38-b16e-57d3968ace6c', '1d041616-e19e-4d7d-8a19-9bc154264402'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] GroupSnapshot e458f23d-cada-4f6a-8f9d-7aa9645a9081: creating. Sep 07 13:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] Group snapshot e458f23d-cada-4f6a-8f9d-7aa9645a9081: creating. {{(pid=87444) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 07 13:50:25 devstack sudo[96267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:25 devstack sudo[96267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] Creating offline snapshot 782ea432-1134-4016-b582-78efe9c50f3f of volume 9a068c27-dc66-4ad1-82d9-4884f7b6b629 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:50:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e263cf-54c9-4ca8-9628-4d8abed0f7d8]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:26 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 Sep 07 13:50:26 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:26 devstack sudo[96267]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] Acquiring lock "cinder-quobyte-b6161e5a-ee22-4e7a-b1ab-e5da0408b632" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.433s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:26 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3652d317-ce47-4273-b3e2-c9f438b52fd2 tempest-GroupsV314Test-751084389 None] Delete group completed successfully. Sep 07 13:50:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] Lock "cinder-quobyte-b6161e5a-ee22-4e7a-b1ab-e5da0408b632" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa3b2c4-e7d4-41fe-9a51-36b9436957c4]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:26 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 Sep 07 13:50:26 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:26 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629" returned: 0 in 0.643s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:26 devstack sudo[96277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f 1G Sep 07 13:50:26 devstack sudo[96277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:26 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632" returned: 0 in 0.514s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:27 devstack sudo[96285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632 Sep 07 13:50:27 devstack sudo[96285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:27 devstack sudo[96277]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f 1G" returned: 0 in 0.568s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:27 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f Sep 07 13:50:27 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:27 devstack sudo[96285]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b6161e5a-ee22-4e7a-b1ab-e5da0408b632" returned: 0 in 0.341s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] Lock "cinder-quobyte-b6161e5a-ee22-4e7a-b1ab-e5da0408b632" released by "delete_volume" :: held 0.957s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:27 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] Created reservations ['c97208c3-9f60-46b6-a6ae-625dc8392dbb'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:27 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] Created reservations ['d18780ed-20f0-4ab4-a9e0-1de577ff6115', '895f2d6b-6302-4ca7-9937-4007cc51b89f', '5509e9cc-b7ee-4a98-afc3-3d0ba4535a37', '341bc62e-7ea9-4d3d-ab26-c82783be0331'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:27 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f" returned: 0 in 0.473s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:27 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:50:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:27 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:50:27 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:27 devstack sudo[96296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f Sep 07 13:50:27 devstack sudo[96296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:28 devstack sudo[96296]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f" returned: 0 in 0.405s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:28 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.info Sep 07 13:50:28 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:28 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.516s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:28 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7b33b5e3-3aa5-4640-9719-d5090241bd7b tempest-GroupsV314Test-751084389 None] Delete group completed successfully. Sep 07 13:50:28 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.info" returned: 0 in 0.313s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:28 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.info is being set with open permissions: ugo+rw: NotImplementedError Sep 07 13:50:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:28 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.info Sep 07 13:50:28 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:28 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.info" returned: 0 in 0.284s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.814s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f3a82daa-9e0c-400f-acf4-608077468d73 tempest-GroupSnapshotsV319Test-574805829 None] group_snapshot e458f23d-cada-4f6a-8f9d-7aa9645a9081: created successfully Sep 07 13:50:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] group_snapshot e458f23d-cada-4f6a-8f9d-7aa9645a9081: deleting Sep 07 13:50:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] group_snapshot e458f23d-cada-4f6a-8f9d-7aa9645a9081: deleting {{(pid=87444) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 07 13:50:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] Acquiring lock "cinder-quobyte-9a068c27-dc66-4ad1-82d9-4884f7b6b629" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] Lock "cinder-quobyte-9a068c27-dc66-4ad1-82d9-4884f7b6b629" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] Acquiring lock "cinder-quobyte-782ea432-1134-4016-b582-78efe9c50f3f" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:50:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] Lock "cinder-quobyte-782ea432-1134-4016-b582-78efe9c50f3f" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] Deleting offline snapshot 782ea432-1134-4016-b582-78efe9c50f3f of volume 9a068c27-dc66-4ad1-82d9-4884f7b6b629 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:50:29 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:50:29 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] snapshot_file for this snap is: volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:50:29 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[462c7367-d7b3-40de-8349-4de195937ac0]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:30 devstack sudo[96309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f Sep 07 13:50:30 devstack sudo[96309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:30 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.538s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:50:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:50:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:50:30 devstack sudo[96309]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f" returned: 0 in 0.531s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:50:30 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de5444d-cc1c-40d4-b734-2e51c332bff9]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:30 devstack sudo[96316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 Sep 07 13:50:30 devstack sudo[96316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:30 devstack sudo[96316]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629" returned: 0 in 0.511s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:31 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f Sep 07 13:50:31 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:31 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f" returned: 0 in 0.474s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:31 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f Sep 07 13:50:31 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:31 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629.782ea432-1134-4016-b582-78efe9c50f3f" returned: 0 in 0.320s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] Lock "cinder-quobyte-782ea432-1134-4016-b582-78efe9c50f3f" released by "_delete_snapshot" :: held 2.014s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] Lock "cinder-quobyte-9a068c27-dc66-4ad1-82d9-4884f7b6b629" released by "delete_snapshot" :: held 2.083s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:31 devstack cinder-volume[87444]: WARNING cinder.quota [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1920575751 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1920575751, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:50:31 devstack cinder-volume[87444]: WARNING cinder.quota [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1920575751 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1920575751, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:50:31 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] Created reservations ['41118cea-e5cd-4b80-ab86-046257c4d46b', '42ec3588-cb63-49d9-9bb6-7f7ed90fb7b4', '766c1bd2-5317-4d8a-8db9-d5cfe182065c', 'b7686aef-9e71-47d8-832b-cf30024cc5b2'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:32 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b8676221-0b69-44c5-bbf2-914a4bc5936c tempest-GroupSnapshotsV319Test-574805829 None] group_snapshot e458f23d-cada-4f6a-8f9d-7aa9645a9081: deleted successfully Sep 07 13:50:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] Acquiring lock "cinder-quobyte-9a068c27-dc66-4ad1-82d9-4884f7b6b629" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:50:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] Lock "cinder-quobyte-9a068c27-dc66-4ad1-82d9-4884f7b6b629" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:50:32 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[30090e4c-fd8d-4371-9792-be1d937e56b4]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:50:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:32 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 Sep 07 13:50:32 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:33 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629" returned: 0 in 0.464s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:33 devstack sudo[96336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629 Sep 07 13:50:33 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:33 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9a068c27-dc66-4ad1-82d9-4884f7b6b629" returned: 0 in 0.287s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] Lock "cinder-quobyte-9a068c27-dc66-4ad1-82d9-4884f7b6b629" released by "delete_volume" :: held 0.856s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:50:33 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] Created reservations ['323b082c-c334-4ece-9a48-e9aabbd5492d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:33 devstack cinder-volume[87444]: WARNING cinder.quota [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1920575751 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1920575751, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:50:33 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] Created reservations ['17f58552-ed65-478a-a3ca-0423cc9a536d', '33020785-836d-4d73-a9f4-e0782e7f8712', '064a7948-1ed9-4a3b-9ca1-8b8b6c4d6547', 'e188ad2d-f64b-4a26-a976-af3949a4a402'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:33 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:50:33 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:34 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.361s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:34 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:34 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-df9b4163-6966-4be7-9249-39e2aee97f9e tempest-GroupSnapshotsV319Test-574805829 None] Delete group completed successfully. Sep 07 13:50:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-41f00bd7-b075-43cd-b07c-eced3492fb46 tempest-GroupsV320Test-975938754 None] Group tempest-GroupsV320Test-Group-308085967: creating Sep 07 13:50:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-41f00bd7-b075-43cd-b07c-eced3492fb46 tempest-GroupsV320Test-975938754 None] Group tempest-GroupsV320Test-Group-308085967: created successfully Sep 07 13:50:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-41f00bd7-b075-43cd-b07c-eced3492fb46 tempest-GroupsV320Test-975938754 None] Create group completed successfully. Sep 07 13:50:45 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-9a164d0b-5a81-444b-bf27-4d2106ed3980 tempest-GroupsV320Test-975938754 None] Created reservations ['315cbc99-b22b-4760-a119-5eab11c5de8f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:50:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9a164d0b-5a81-444b-bf27-4d2106ed3980 tempest-GroupsV320Test-975938754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9a164d0b-5a81-444b-bf27-4d2106ed3980 tempest-GroupsV320Test-975938754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9a164d0b-5a81-444b-bf27-4d2106ed3980 tempest-GroupsV320Test-975938754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9a164d0b-5a81-444b-bf27-4d2106ed3980 tempest-GroupsV320Test-975938754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9a164d0b-5a81-444b-bf27-4d2106ed3980 tempest-GroupsV320Test-975938754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9a164d0b-5a81-444b-bf27-4d2106ed3980 tempest-GroupsV320Test-975938754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:45 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:50:45 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:46 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9a164d0b-5a81-444b-bf27-4d2106ed3980 tempest-GroupsV320Test-975938754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.390s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:46 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-9a164d0b-5a81-444b-bf27-4d2106ed3980 tempest-GroupsV320Test-975938754 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:50:46 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9a164d0b-5a81-444b-bf27-4d2106ed3980 tempest-GroupsV320Test-975938754 None] Delete group completed successfully. Sep 07 13:50:52 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=95,cinder:UPDATE=103,cinder:DELETE=4,cinder:INSERT=20 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:50:52 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=87,cinder:INSERT=26,cinder:UPDATE=80,cinder:DELETE=3 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:50:54 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Flow 'volume_create_manager' (8fe4bf58-f38d-4cdf-a0ec-47abda7ce5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1904e088-39d1-4aee-acc4-af91c619e070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1904e088-39d1-4aee-acc4-af91c619e070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1841784038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a8d931-4448-4d3c-be88-c70ac854d4dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf60520da2a04e85845a86befaa8371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:55Z,use_quota=True,user_id='5c2ee1769bfb4fe882429f42c5e04177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(183d724a-b3a4-4af9-afbc-753794757852),volume_type_id=183d724a-b3a4-4af9-afbc-753794757852)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d4c4c9-50ca-4cc8-aa09-30f16a2987ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d4c4c9-50ca-4cc8-aa09-30f16a2987ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (effccdeb-ff2f-4949-98c5-9d8749c42505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (effccdeb-ff2f-4949-98c5-9d8749c42505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01a8d931-4448-4d3c-be88-c70ac854d4dd', 'volume_name': 'volume-01a8d931-4448-4d3c-be88-c70ac854d4dd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8cf2d47-3829-42a9-8d4c-3fa630e099b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8cf2d47-3829-42a9-8d4c-3fa630e099b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eab30ec-987a-43c5-b9c7-472359111182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:55 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Volume 01a8d931-4448-4d3c-be88-c70ac854d4dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01a8d931-4448-4d3c-be88-c70ac854d4dd', 'volume_size': 1} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1841784038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a8d931-4448-4d3c-be88-c70ac854d4dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf60520da2a04e85845a86befaa8371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:55Z,use_quota=True,user_id='5c2ee1769bfb4fe882429f42c5e04177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(183d724a-b3a4-4af9-afbc-753794757852),volume_type_id=183d724a-b3a4-4af9-afbc-753794757852)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Creating volume 01a8d931-4448-4d3c-be88-c70ac854d4dd {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:50:55 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:50:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01a8d931-4448-4d3c-be88-c70ac854d4dd 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:55 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01a8d931-4448-4d3c-be88-c70ac854d4dd 1073741824 Sep 07 13:50:55 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:56 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01a8d931-4448-4d3c-be88-c70ac854d4dd 1073741824" returned: 0 in 0.876s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01a8d931-4448-4d3c-be88-c70ac854d4dd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:56 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01a8d931-4448-4d3c-be88-c70ac854d4dd Sep 07 13:50:56 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Flow 'volume_create_manager' (5e91f806-45d9-44e8-b2eb-582b505c569e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868de0c3-0b15-45c2-982e-3cfe1f574f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (868de0c3-0b15-45c2-982e-3cfe1f574f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1842347000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e823d3-2ccb-4138-8516-c9fe9390b045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf60520da2a04e85845a86befaa8371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:56Z,use_quota=True,user_id='5c2ee1769bfb4fe882429f42c5e04177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22950092-4edb-4ccc-87a9-0b3b904f7530),volume_type_id=22950092-4edb-4ccc-87a9-0b3b904f7530)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1131286-b4e0-463c-ae63-9fdf8b277801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1131286-b4e0-463c-ae63-9fdf8b277801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef214687-d90f-4a95-8ba8-4e62630b2234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef214687-d90f-4a95-8ba8-4e62630b2234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8e823d3-2ccb-4138-8516-c9fe9390b045', 'volume_name': 'volume-b8e823d3-2ccb-4138-8516-c9fe9390b045', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341b4640-6c90-4293-a7ef-0ed1b0abb8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341b4640-6c90-4293-a7ef-0ed1b0abb8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84bf2f49-7646-4b30-b1bf-15b50dce8344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:56 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Volume b8e823d3-2ccb-4138-8516-c9fe9390b045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8e823d3-2ccb-4138-8516-c9fe9390b045', 'volume_size': 1} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:56 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01a8d931-4448-4d3c-be88-c70ac854d4dd" returned: 0 in 0.467s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] <== create_volume: return (1417ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.421s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.101s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1842347000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8e823d3-2ccb-4138-8516-c9fe9390b045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf60520da2a04e85845a86befaa8371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:56Z,use_quota=True,user_id='5c2ee1769bfb4fe882429f42c5e04177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22950092-4edb-4ccc-87a9-0b3b904f7530),volume_type_id=22950092-4edb-4ccc-87a9-0b3b904f7530)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Creating volume b8e823d3-2ccb-4138-8516-c9fe9390b045 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:50:56 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b8e823d3-2ccb-4138-8516-c9fe9390b045 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:56 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b8e823d3-2ccb-4138-8516-c9fe9390b045 1073741824 Sep 07 13:50:56 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eab30ec-987a-43c5-b9c7-472359111182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a8d931-4448-4d3c-be88-c70ac854d4dd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3423bc4-06cf-44c3-a2b7-9608224d8ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:56 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Volume volume-01a8d931-4448-4d3c-be88-c70ac854d4dd (01a8d931-4448-4d3c-be88-c70ac854d4dd): created successfully Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3423bc4-06cf-44c3-a2b7-9608224d8ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Flow 'volume_create_manager' (8fe4bf58-f38d-4cdf-a0ec-47abda7ce5d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:56 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3f6635e7-5223-4e21-9980-c24e669db288 tempest-TestInstancesWithCinderVolumes-1283372801 None] Created volume successfully. Sep 07 13:50:57 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b8e823d3-2ccb-4138-8516-c9fe9390b045 1073741824" returned: 0 in 1.121s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:57 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:50:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Flow 'volume_create_manager' (3dee55e9-b118-4fb0-b99c-a95c93871483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41ab9e3-0a54-4180-bbca-595e8369ebb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f41ab9e3-0a54-4180-bbca-595e8369ebb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1394392890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d911fe-e3ef-449f-a7b6-b0c05dfcce67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf60520da2a04e85845a86befaa8371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:58Z,use_quota=True,user_id='5c2ee1769bfb4fe882429f42c5e04177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46845399-b49c-4c7d-ba79-612809484596),volume_type_id=46845399-b49c-4c7d-ba79-612809484596)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed1f386-a58a-44a8-968b-76d0fe70513c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ed1f386-a58a-44a8-968b-76d0fe70513c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7cf266c-d166-4be5-9e15-947cb4983ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:57 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 13:50:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b8e823d3-2ccb-4138-8516-c9fe9390b045 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:50:57 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b8e823d3-2ccb-4138-8516-c9fe9390b045 Sep 07 13:50:57 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:50:58 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 07 13:50:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b8e823d3-2ccb-4138-8516-c9fe9390b045" returned: 0 in 0.434s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:50:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:50:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:50:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84bf2f49-7646-4b30-b1bf-15b50dce8344) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8e823d3-2ccb-4138-8516-c9fe9390b045', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29beaa4-3521-4a18-831b-eb9c4048c481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7cf266c-d166-4be5-9e15-947cb4983ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '94d911fe-e3ef-449f-a7b6-b0c05dfcce67', 'volume_name': 'volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67', 'volume_size': 1, 'image_id': 'ca021f89-00e3-410b-9385-4463a5847b84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca021f89-00e3-410b-9385-4463a5847b84', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--750170971', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf60520da2a04e85845a86befaa8371a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ca021f89-00e3-410b-9385-4463a5847b84', 'created_at': datetime.datetime(2026, 9, 7, 11, 50, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 50, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca021f89-00e3-410b-9385-4463a5847b84/file', 'properties': {}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e2892a-bfdb-4a39-be76-0fd9c3600f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e2892a-bfdb-4a39-be76-0fd9c3600f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1767715-109b-499f-92dd-27202a4456ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:50:58 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Volume 94d911fe-e3ef-449f-a7b6-b0c05dfcce67: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67', 'volume_size': 1, 'image_id': 'ca021f89-00e3-410b-9385-4463a5847b84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca021f89-00e3-410b-9385-4463a5847b84', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--750170971', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf60520da2a04e85845a86befaa8371a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ca021f89-00e3-410b-9385-4463a5847b84', 'created_at': datetime.datetime(2026, 9, 7, 11, 50, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 50, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca021f89-00e3-410b-9385-4463a5847b84/file', 'properties': {}}, 'image_service': } Sep 07 13:50:58 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Trying to clone 94d911fe-e3ef-449f-a7b6-b0c05dfcce67 from image ca021f89-00e3-410b-9385-4463a5847b84 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ca021f89-00e3-410b-9385-4463a5847b84', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 13:50:58 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Volume volume-b8e823d3-2ccb-4138-8516-c9fe9390b045 (b8e823d3-2ccb-4138-8516-c9fe9390b045): created successfully Sep 07 13:50:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d29beaa4-3521-4a18-831b-eb9c4048c481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:50:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Flow 'volume_create_manager' (5e91f806-45d9-44e8-b2eb-582b505c569e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:50:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-56c14e9d-b251-4a6c-9ea8-0fdcc2e6e1c1 tempest-TestInstancesWithCinderVolumes-1283372801 None] Created volume successfully. Sep 07 13:51:03 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ca021f89-00e3-410b-9385-4463a5847b84_fga05x44devstack@QuobyteHD, size 20.69 MB, duration 5.27 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 13:51:03 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Image download 20.69 MB at 3.92 MB/s Sep 07 13:51:03 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8763a7ca-bce5-4dad-961c-3c1e1109c893]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca021f89-00e3-410b-9385-4463a5847b84_fga05x44devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:04 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca021f89-00e3-410b-9385-4463a5847b84_fga05x44devstack@QuobyteHD Sep 07 13:51:04 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:04 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca021f89-00e3-410b-9385-4463a5847b84_fga05x44devstack@QuobyteHD" returned: 0 in 0.683s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:04 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Temporary image ca021f89-00e3-410b-9385-4463a5847b84 is fetched for user 5c2ee1769bfb4fe882429f42c5e04177. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 13:51:04 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5653365f-e67d-42d4-a1b4-049228b8c250]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca021f89-00e3-410b-9385-4463a5847b84_fga05x44devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:04 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca021f89-00e3-410b-9385-4463a5847b84_fga05x44devstack@QuobyteHD Sep 07 13:51:04 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:04 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca021f89-00e3-410b-9385-4463a5847b84_fga05x44devstack@QuobyteHD" returned: 0 in 0.458s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1394392890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94d911fe-e3ef-449f-a7b6-b0c05dfcce67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf60520da2a04e85845a86befaa8371a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:50:58Z,use_quota=True,user_id='5c2ee1769bfb4fe882429f42c5e04177',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46845399-b49c-4c7d-ba79-612809484596),volume_type_id=46845399-b49c-4c7d-ba79-612809484596)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:51:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Creating volume 94d911fe-e3ef-449f-a7b6-b0c05dfcce67 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:51:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:04 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:51:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:05 devstack sudo[96519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67 1073741824 Sep 07 13:51:05 devstack sudo[96519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:05 devstack sudo[96519]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67 1073741824" returned: 0 in 0.585s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:05 devstack sudo[96525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67 Sep 07 13:51:05 devstack sudo[96525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:06 devstack sudo[96525]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67" returned: 0 in 0.428s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:51:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:06 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Attempting download of ca021f89-00e3-410b-9385-4463a5847b84 ((None, [{'url': 'file:///opt/stack/data/glance/images/ca021f89-00e3-410b-9385-4463a5847b84', 'metadata': {}}])) to volume 94d911fe-e3ef-449f-a7b6-b0c05dfcce67. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 13:51:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf57090b-5703-47ce-9eb0-d228509f6791]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca021f89-00e3-410b-9385-4463a5847b84_v6ysuf3r {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:06 devstack sudo[96534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca021f89-00e3-410b-9385-4463a5847b84_v6ysuf3r Sep 07 13:51:06 devstack sudo[96534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:06 devstack sudo[96534]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ca021f89-00e3-410b-9385-4463a5847b84_v6ysuf3r" returned: 0 in 0.590s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca021f89-00e3-410b-9385-4463a5847b84_v6ysuf3r {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:06 devstack sudo[96542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca021f89-00e3-410b-9385-4463a5847b84_v6ysuf3r Sep 07 13:51:06 devstack sudo[96542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:07 devstack sudo[96542]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca021f89-00e3-410b-9385-4463a5847b84_v6ysuf3r" returned: 1 in 0.364s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ca021f89-00e3-410b-9385-4463a5847b84_v6ysuf3r' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:51:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e3c98d-6416-49d3-87ee-f4b6f3b1f574]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca021f89-00e3-410b-9385-4463a5847b84_fga05x44devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:07 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca021f89-00e3-410b-9385-4463a5847b84_fga05x44devstack@QuobyteHD Sep 07 13:51:07 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:07 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ca021f89-00e3-410b-9385-4463a5847b84_fga05x44devstack@QuobyteHD" returned: 0 in 0.496s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:07 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] ca021f89-00e3-410b-9385-4463a5847b84 was qcow2, converting to qcow2 {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 13:51:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ca021f89-00e3-410b-9385-4463a5847b84_fga05x44devstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:07 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ca021f89-00e3-410b-9385-4463a5847b84_fga05x44devstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67 Sep 07 13:51:07 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:09 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ca021f89-00e3-410b-9385-4463a5847b84_fga05x44devstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67" returned: 0 in 2.314s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:10 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ca021f89-00e3-410b-9385-4463a5847b84_fga05x44devstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:51:10 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Converted 112.00 MB image at 48.38 MB/s Sep 07 13:51:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:10 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67 1G Sep 07 13:51:10 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:10 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67 1G" returned: 0 in 0.385s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:10 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Downloaded image ca021f89-00e3-410b-9385-4463a5847b84 ((None, [{'url': 'file:///opt/stack/data/glance/images/ca021f89-00e3-410b-9385-4463a5847b84', 'metadata': {}}])) to volume 94d911fe-e3ef-449f-a7b6-b0c05dfcce67 successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 13:51:10 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Temporary image ca021f89-00e3-410b-9385-4463a5847b84 for user 5c2ee1769bfb4fe882429f42c5e04177 is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 13:51:10 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Marking volume 94d911fe-e3ef-449f-a7b6-b0c05dfcce67 as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 13:51:10 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Copying metadata from image ca021f89-00e3-410b-9385-4463a5847b84 to 94d911fe-e3ef-449f-a7b6-b0c05dfcce67. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 13:51:10 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Creating volume glance metadata for volume 94d911fe-e3ef-449f-a7b6-b0c05dfcce67 backed by image ca021f89-00e3-410b-9385-4463a5847b84 with: {'image_id': 'ca021f89-00e3-410b-9385-4463a5847b84', 'image_name': 'tempest-scenario-img--750170971', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 13:51:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1767715-109b-499f-92dd-27202a4456ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67', 'volume_size': 1, 'image_id': 'ca021f89-00e3-410b-9385-4463a5847b84', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ca021f89-00e3-410b-9385-4463a5847b84', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--750170971', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bf60520da2a04e85845a86befaa8371a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ca021f89-00e3-410b-9385-4463a5847b84', 'created_at': datetime.datetime(2026, 9, 7, 11, 50, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 50, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ca021f89-00e3-410b-9385-4463a5847b84/file', 'properties': {}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6b237b-90f4-444d-83c2-9e71e9c42653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:10 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Volume volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67 (94d911fe-e3ef-449f-a7b6-b0c05dfcce67): created successfully Sep 07 13:51:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac6b237b-90f4-444d-83c2-9e71e9c42653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Flow 'volume_create_manager' (3dee55e9-b118-4fb0-b99c-a95c93871483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2068b458-efa5-4b74-aec3-f6b0d59773c6 tempest-TestInstancesWithCinderVolumes-1283372801 None] Created volume successfully. Sep 07 13:51:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-e676811a-8f37-4428-8bbe-05d9b5358877 req-118ce0a6-d131-449a-a665-9cadbeac2db8 tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-e676811a-8f37-4428-8bbe-05d9b5358877 req-118ce0a6-d131-449a-a665-9cadbeac2db8 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-e676811a-8f37-4428-8bbe-05d9b5358877 req-118ce0a6-d131-449a-a665-9cadbeac2db8 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-e676811a-8f37-4428-8bbe-05d9b5358877 req-118ce0a6-d131-449a-a665-9cadbeac2db8 tempest-TestInstancesWithCinderVolumes-1283372801 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '227fe783-0bf5-4c41-b162-b5996493b400', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:51:13 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-e676811a-8f37-4428-8bbe-05d9b5358877 req-118ce0a6-d131-449a-a665-9cadbeac2db8 tempest-TestInstancesWithCinderVolumes-1283372801 None] attachment_update completed successfully. Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Flow 'volume_create_manager' (67ef51d1-1ac2-4c4e-9c10-ebf41f074ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (353faca2-4472-4ac2-8428-8c92e4e9f676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (353faca2-4472-4ac2-8428-8c92e4e9f676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-965191682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0888fc5-ae25-472c-a58d-7010d5b57fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60609b23b00849b7862a67f30b73b7de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:22Z,use_quota=True,user_id='289685d77d9f40e6908c9888b8db38f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b03d92b-4198-4484-b4cf-5745488da81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b03d92b-4198-4484-b4cf-5745488da81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89f3cca-616d-46e1-a6a8-7281e20ad564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e89f3cca-616d-46e1-a6a8-7281e20ad564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0888fc5-ae25-472c-a58d-7010d5b57fbf', 'volume_name': 'volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fccb8e9-fc6c-444d-b468-65683b2aabd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fccb8e9-fc6c-444d-b468-65683b2aabd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786d4f69-60c2-4a0a-8c99-1fec20192872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:22 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Volume b0888fc5-ae25-472c-a58d-7010d5b57fbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf', 'volume_size': 1} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-965191682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0888fc5-ae25-472c-a58d-7010d5b57fbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60609b23b00849b7862a67f30b73b7de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:22Z,use_quota=True,user_id='289685d77d9f40e6908c9888b8db38f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Creating volume b0888fc5-ae25-472c-a58d-7010d5b57fbf {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:22 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:51:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:22 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf 1073741824 Sep 07 13:51:22 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:23 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf 1073741824" returned: 0 in 0.949s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:23 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf Sep 07 13:51:23 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:23 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf" returned: 0 in 0.565s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:51:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786d4f69-60c2-4a0a-8c99-1fec20192872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2e4141-52ce-49bb-84a2-57013de80045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:23 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Volume volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf (b0888fc5-ae25-472c-a58d-7010d5b57fbf): created successfully Sep 07 13:51:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a2e4141-52ce-49bb-84a2-57013de80045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Flow 'volume_create_manager' (67ef51d1-1ac2-4c4e-9c10-ebf41f074ea3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:23 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d757a9da-196d-4f61-9daf-fb6ac9bc8bc8 tempest-AttachVolumeNegativeTest-257270736 None] Created volume successfully. Sep 07 13:51:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-113e4faf-bbad-458c-a0fa-11a2546184a2 req-9f4e9e32-c738-40e8-88fc-7c9321089ebc tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-113e4faf-bbad-458c-a0fa-11a2546184a2 req-9f4e9e32-c738-40e8-88fc-7c9321089ebc tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-113e4faf-bbad-458c-a0fa-11a2546184a2 req-9f4e9e32-c738-40e8-88fc-7c9321089ebc tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-113e4faf-bbad-458c-a0fa-11a2546184a2 req-9f4e9e32-c738-40e8-88fc-7c9321089ebc tempest-AttachVolumeNegativeTest-257270736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d3c841f-6973-4f30-9056-a8e5bfc8f252', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:51:27 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-113e4faf-bbad-458c-a0fa-11a2546184a2 req-9f4e9e32-c738-40e8-88fc-7c9321089ebc tempest-AttachVolumeNegativeTest-257270736 None] attachment_update completed successfully. Sep 07 13:51:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:51:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:29 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:51:29 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:30 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.655s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:51:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:51:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:51:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Flow 'volume_create_manager' (56e05a76-4bed-40b6-931f-1d0f22caa123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57afa8d6-2c9c-4fe2-9c07-74bf75c3bd5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57afa8d6-2c9c-4fe2-9c07-74bf75c3bd5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-224035154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40cd2d45a145678e914a082e703705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:32Z,use_quota=True,user_id='cd6bbffbc1ff47f993d7ae591aa12d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2f5b55-21c2-4484-8bc2-47da3dac3a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc2f5b55-21c2-4484-8bc2-47da3dac3a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98606ae2-3654-4c15-bb22-388bf1c7b24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98606ae2-3654-4c15-bb22-388bf1c7b24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7', 'volume_name': 'volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc2819e-dcbe-4e2e-8d1b-ed020e43058c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bc2819e-dcbe-4e2e-8d1b-ed020e43058c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1efa47-35dd-46c5-bda1-04421f751648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:31 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Volume 01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7', 'volume_size': 1} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-224035154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40cd2d45a145678e914a082e703705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:32Z,use_quota=True,user_id='cd6bbffbc1ff47f993d7ae591aa12d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Creating volume 01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:31 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:51:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:31 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 1073741824 Sep 07 13:51:31 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:32 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 1073741824" returned: 0 in 0.952s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:32 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 Sep 07 13:51:32 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:33 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7" returned: 0 in 0.439s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] <== create_volume: return (1493ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:51:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1efa47-35dd-46c5-bda1-04421f751648) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b41ce9-075a-4ab7-982f-00709a8bf508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:33 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Volume volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 (01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7): created successfully Sep 07 13:51:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75b41ce9-075a-4ab7-982f-00709a8bf508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Flow 'volume_create_manager' (56e05a76-4bed-40b6-931f-1d0f22caa123) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-382ee261-31b0-4d36-a998-23c4eb7c790b tempest-VolumesDeleteCascade-1725989864 None] Created volume successfully. Sep 07 13:51:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] Creating offline snapshot 048fc4c9-b737-43f5-a4a6-c868b1c9ceeb of volume 01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:51:34 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c7850d-d18c-4e2f-9e09-213335010345]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:34 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 Sep 07 13:51:34 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:34 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7" returned: 0 in 0.524s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:34 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb 1G Sep 07 13:51:34 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:35 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb 1G" returned: 0 in 0.663s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:35 devstack sudo[97105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb Sep 07 13:51:35 devstack sudo[97105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:35 devstack sudo[97105]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb" returned: 0 in 0.503s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:35 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb is being set with open permissions: ugo+rw Sep 07 13:51:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:36 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb Sep 07 13:51:36 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:36 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:51:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Flow 'volume_create_manager' (c20ff33a-48a9-463d-b30b-8b3909e4d2c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00700f76-58e7-4a2c-91d8-06c485e3ca73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00700f76-58e7-4a2c-91d8-06c485e3ca73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-754805723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a746ec41-053e-471c-996a-791322e6a3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4c2a079c3a4fc694439773109f681d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:36Z,use_quota=True,user_id='0137a3dbd8714810a4637e79085ed3b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36af8863-43d5-4cf3-9ba3-456031f30beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36af8863-43d5-4cf3-9ba3-456031f30beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d04dfe6-558f-4af7-a445-825efc12fe54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d04dfe6-558f-4af7-a445-825efc12fe54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a746ec41-053e-471c-996a-791322e6a3dd', 'volume_name': 'volume-a746ec41-053e-471c-996a-791322e6a3dd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121429a1-034b-4789-92ad-55073f86fe1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (121429a1-034b-4789-92ad-55073f86fe1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e163ae19-4a6d-4a7d-a676-e0fb6c9062f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:36 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Volume a746ec41-053e-471c-996a-791322e6a3dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a746ec41-053e-471c-996a-791322e6a3dd', 'volume_size': 1} Sep 07 13:51:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:36 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb" returned: 0 in 0.385s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:36 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.info Sep 07 13:51:36 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:36 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.info" returned: 0 in 0.379s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:36 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.info is being set with open permissions: ugo+rw Sep 07 13:51:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:36 devstack sudo[97146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.info Sep 07 13:51:36 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:37 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.info" returned: 0 in 0.383s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.956s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.948s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-754805723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a746ec41-053e-471c-996a-791322e6a3dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b4c2a079c3a4fc694439773109f681d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:36Z,use_quota=True,user_id='0137a3dbd8714810a4637e79085ed3b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:51:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Creating volume a746ec41-053e-471c-996a-791322e6a3dd {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:51:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:37 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:51:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:37 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd 1073741824 Sep 07 13:51:37 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-78d45d73-bc35-4a0a-a563-6287f97529b9 tempest-VolumesDeleteCascade-1725989864 None] Create snapshot completed successfully Sep 07 13:51:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-92abeb47-bd17-4502-863a-7e43f874af36 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:37 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd 1073741824" returned: 0 in 0.737s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:38 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd Sep 07 13:51:38 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:38 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd" returned: 0 in 0.345s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] <== create_volume: return (1153ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:51:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-92abeb47-bd17-4502-863a-7e43f874af36 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.534s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e163ae19-4a6d-4a7d-a676-e0fb6c9062f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a746ec41-053e-471c-996a-791322e6a3dd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2016b404-86a5-4939-9638-8e20c4f6d84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-92abeb47-bd17-4502-863a-7e43f874af36 tempest-VolumesDeleteCascade-1725989864 None] Creating offline snapshot a42809ac-da26-4971-816e-cf93bb83f18f of volume 01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:51:38 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Volume volume-a746ec41-053e-471c-996a-791322e6a3dd (a746ec41-053e-471c-996a-791322e6a3dd): created successfully Sep 07 13:51:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2016b404-86a5-4939-9638-8e20c4f6d84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Flow 'volume_create_manager' (c20ff33a-48a9-463d-b30b-8b3909e4d2c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:38 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8a9ee17-a342-43b3-9acb-2b5af4f69231]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-92abeb47-bd17-4502-863a-7e43f874af36 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:38 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-db81558c-72d2-41a6-a389-46c29436bb71 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Created volume successfully. Sep 07 13:51:38 devstack sudo[97182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb Sep 07 13:51:38 devstack sudo[97182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:38 devstack sudo[97182]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-92abeb47-bd17-4502-863a-7e43f874af36 tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb" returned: 0 in 0.424s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-92abeb47-bd17-4502-863a-7e43f874af36 tempest-VolumesDeleteCascade-1725989864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:51:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-92abeb47-bd17-4502-863a-7e43f874af36 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:38 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f 1G Sep 07 13:51:38 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:39 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-92abeb47-bd17-4502-863a-7e43f874af36 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f 1G" returned: 0 in 0.511s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-92abeb47-bd17-4502-863a-7e43f874af36 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:39 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f Sep 07 13:51:39 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:39 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-92abeb47-bd17-4502-863a-7e43f874af36 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f" returned: 0 in 0.340s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:39 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-92abeb47-bd17-4502-863a-7e43f874af36 tempest-VolumesDeleteCascade-1725989864 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f is being set with open permissions: ugo+rw Sep 07 13:51:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-92abeb47-bd17-4502-863a-7e43f874af36 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:39 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f Sep 07 13:51:39 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:40 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-92abeb47-bd17-4502-863a-7e43f874af36 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f" returned: 0 in 0.435s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-92abeb47-bd17-4502-863a-7e43f874af36 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.870s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.700s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Creating offline snapshot 8e581a44-2fc7-40c0-a456-6d0fd760f135 of volume a746ec41-053e-471c-996a-791322e6a3dd {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:51:40 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-92abeb47-bd17-4502-863a-7e43f874af36 tempest-VolumesDeleteCascade-1725989864 None] Create snapshot completed successfully Sep 07 13:51:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4761303-008d-4303-8182-14bd3cd3dbd8]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:40 devstack sudo[97236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd Sep 07 13:51:40 devstack sudo[97236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:41 devstack sudo[97236]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd" returned: 0 in 0.640s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:41 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135 1G Sep 07 13:51:41 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Performing cascade delete. {{(pid=87444) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-048fc4c9-b737-43f5-a4a6-c868b1c9ceeb-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-048fc4c9-b737-43f5-a4a6-c868b1c9ceeb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-quobyte-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-quobyte-048fc4c9-b737-43f5-a4a6-c868b1c9ceeb" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-048fc4c9-b737-43f5-a4a6-c868b1c9ceeb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Deleting offline snapshot 048fc4c9-b737-43f5-a4a6-c868b1c9ceeb of volume 01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] snapshot_file for this snap is: volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3495a20-d219-43cc-9e22-ddec925b5589]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:41 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb Sep 07 13:51:41 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:41 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135 1G" returned: 0 in 0.651s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a746ec41-053e-471c-996a-791322e6a3dd -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:41 devstack sudo[97296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a746ec41-053e-471c-996a-791322e6a3dd -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135 Sep 07 13:51:41 devstack sudo[97296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:41 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb" returned: 0 in 0.643s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:51:42 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de88331-a935-48f5-b7cd-991f93841def]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:42 devstack sudo[97296]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a746ec41-053e-471c-996a-791322e6a3dd -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135" returned: 0 in 0.397s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:42 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135 is being set with open permissions: ugo+rw Sep 07 13:51:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:42 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135 Sep 07 13:51:42 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:42 devstack sudo[97306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 Sep 07 13:51:42 devstack sudo[97306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:42 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135" returned: 0 in 0.311s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:42 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.info Sep 07 13:51:42 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:42 devstack sudo[97306]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7" returned: 0 in 0.467s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:42 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f910379-f3d9-4d3f-91dd-31f755d82dd9]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:42 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f Sep 07 13:51:42 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:42 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.info" returned: 0 in 0.325s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:42 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.info is being set with open permissions: ugo+rw Sep 07 13:51:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:42 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.info Sep 07 13:51:42 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:42 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f" returned: 0 in 0.440s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:51:43 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6e9762-e565-49d4-ae24-c577772ad65d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:43 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.info" returned: 0 in 0.332s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.832s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7e02355c-08b5-4e0b-a371-e0e6cde07cfe tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Create snapshot completed successfully Sep 07 13:51:43 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb Sep 07 13:51:43 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:43 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb" returned: 0 in 0.470s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:51:43 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff67be8-98da-49f6-9f38-69b859e3ef28]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:43 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 Sep 07 13:51:43 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:43 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7" returned: 0 in 0.455s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:44 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb Sep 07 13:51:44 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:44 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb" returned: 0 in 0.563s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:44 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb Sep 07 13:51:44 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Acquiring lock "cinder-8e581a44-2fc7-40c0-a456-6d0fd760f135-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "cinder-8e581a44-2fc7-40c0-a456-6d0fd760f135-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Acquiring lock "cinder-quobyte-a746ec41-053e-471c-996a-791322e6a3dd" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "cinder-quobyte-a746ec41-053e-471c-996a-791322e6a3dd" acquired by "delete_snapshot" :: waited 0.086s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Acquiring lock "cinder-quobyte-8e581a44-2fc7-40c0-a456-6d0fd760f135" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "cinder-quobyte-8e581a44-2fc7-40c0-a456-6d0fd760f135" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Deleting offline snapshot 8e581a44-2fc7-40c0-a456-6d0fd760f135 of volume a746ec41-053e-471c-996a-791322e6a3dd {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] snapshot_file for this snap is: volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:51:44 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c3acfa-9b31-4df5-a9e1-8f031ab09c33]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:45 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.048fc4c9-b737-43f5-a4a6-c868b1c9ceeb" returned: 0 in 0.518s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f -F qcow2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:45 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f -F qcow2 Sep 07 13:51:45 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:45 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135 Sep 07 13:51:45 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:45 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f -F qcow2" returned: 0 in 0.493s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-048fc4c9-b737-43f5-a4a6-c868b1c9ceeb" released by "_delete_snapshot" :: held 4.282s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7" released by "delete_snapshot" :: held 4.314s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135" returned: 0 in 0.836s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a746ec41-053e-471c-996a-791322e6a3dd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:51:45 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:45 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[26347ba6-6045-47b5-b7ae-466586a5ee79]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:45 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Created reservations ['9a3b744e-9b56-428d-9bee-87927d93f5f7', 'ab4c96be-ef6f-49f8-8b23-89be9f2cdecb', '614687b3-1c27-4c93-984d-9580820a4ea8', 'cedf060e-97bb-4330-bcf9-8bd3457a13c0'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:45 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd Sep 07 13:51:45 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Delete snapshot completed successfully. Sep 07 13:51:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-048fc4c9-b737-43f5-a4a6-c868b1c9ceeb-delete_snapshot" released by "delete_snapshot" :: held 4.692s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-a42809ac-da26-4971-816e-cf93bb83f18f-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-a42809ac-da26-4971-816e-cf93bb83f18f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-quobyte-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-quobyte-a42809ac-da26-4971-816e-cf93bb83f18f" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-a42809ac-da26-4971-816e-cf93bb83f18f" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Deleting offline snapshot a42809ac-da26-4971-816e-cf93bb83f18f of volume 01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] snapshot_file for this snap is: volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8197e2a4-d851-4d0c-a547-4c2fccac7c70]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:46 devstack sudo[97360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f Sep 07 13:51:46 devstack sudo[97360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:46 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd" returned: 0 in 0.513s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:46 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135 Sep 07 13:51:46 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:46 devstack sudo[97360]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f" returned: 0 in 0.410s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[20131462-e610-4c54-aa9c-3483935f12f5]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:46 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135" returned: 0 in 0.410s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:46 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 Sep 07 13:51:46 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:46 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135 Sep 07 13:51:46 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:46 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd.8e581a44-2fc7-40c0-a456-6d0fd760f135" returned: 0 in 0.318s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "cinder-quobyte-8e581a44-2fc7-40c0-a456-6d0fd760f135" released by "_delete_snapshot" :: held 2.229s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "cinder-quobyte-a746ec41-053e-471c-996a-791322e6a3dd" released by "delete_snapshot" :: held 2.269s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:47 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7" returned: 0 in 0.537s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:47 devstack sudo[97382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f Sep 07 13:51:47 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:47 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Created reservations ['cf339aef-e940-4f2c-8df9-7e6e2a4f5c4c', '0f14d761-ba55-453d-ae38-429c0554c885', '6866d526-54fd-44d9-a2bd-879d33668540', 'dfd9639d-c69a-432a-a898-95b3429d5031'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Delete snapshot completed successfully. Sep 07 13:51:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc3da131-49ef-4dbf-834d-77df39b595c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "cinder-8e581a44-2fc7-40c0-a456-6d0fd760f135-delete_snapshot" released by "delete_snapshot" :: held 2.514s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:47 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f" returned: 0 in 0.372s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:47 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f Sep 07 13:51:47 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:47 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7.a42809ac-da26-4971-816e-cf93bb83f18f" returned: 0 in 0.261s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-a42809ac-da26-4971-816e-cf93bb83f18f" released by "_delete_snapshot" :: held 1.694s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7" released by "delete_snapshot" :: held 1.740s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:47 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Created reservations ['bd60ee53-0da9-4c87-aba9-e0b4e00d8e82', '40bf9f2c-ebfb-43b9-9e8a-dae5df8fd084', '68ce7ea4-80ec-40d0-adcf-9a8b8a15270c', 'e975afc5-c803-44a8-9c95-1b52cdc10413'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Delete snapshot completed successfully. Sep 07 13:51:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-a42809ac-da26-4971-816e-cf93bb83f18f-delete_snapshot" released by "delete_snapshot" :: held 1.957s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Snapshots deleted, issuing volume delete {{(pid=87444) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 07 13:51:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-quobyte-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:48 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[41151158-38f2-46d7-86e1-6d67c9f76151]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Acquiring lock "cinder-a746ec41-053e-471c-996a-791322e6a3dd-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "cinder-a746ec41-053e-471c-996a-791322e6a3dd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:48 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 Sep 07 13:51:48 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Acquiring lock "cinder-quobyte-a746ec41-053e-471c-996a-791322e6a3dd" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "cinder-quobyte-a746ec41-053e-471c-996a-791322e6a3dd" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:48 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee89753-6696-4ec3-bee6-7f9dd1406091]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:48 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd Sep 07 13:51:48 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:48 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7" returned: 0 in 0.604s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:48 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7 Sep 07 13:51:48 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:48 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd" returned: 0 in 0.529s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:48 devstack sudo[97416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd Sep 07 13:51:48 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:49 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7" returned: 0 in 0.474s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7" released by "delete_volume" :: held 1.188s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:49 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a746ec41-053e-471c-996a-791322e6a3dd" returned: 0 in 0.344s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "cinder-quobyte-a746ec41-053e-471c-996a-791322e6a3dd" released by "delete_volume" :: held 0.948s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Created reservations ['a5455aa4-0550-429b-b074-7330108e457b', '0f32587b-de57-4df1-a06e-b806aab3e8a4', '2d48d757-f8ce-4cb6-bbb9-7f89d317db7c', '6f3e11c7-9448-49fc-84e0-f36f43c639fd'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Created reservations ['7be2eed1-536c-49f5-8395-63573dec8b74', 'e5565daf-862e-4d75-8469-51e22bcd6baa', 'e6b5f6bb-441c-4c53-820e-d230e22f0a2a', 'bc97edf6-aa59-461a-9cad-0a017d31b104'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-6fc1cb4f-fb69-470c-890e-d5c55912d9a3 req-74ec1c06-9f6b-44b7-b38e-52bd361c96dd tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-6fc1cb4f-fb69-470c-890e-d5c55912d9a3 req-74ec1c06-9f6b-44b7-b38e-52bd361c96dd tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:49 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:51:49 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-6fc1cb4f-fb69-470c-890e-d5c55912d9a3 req-74ec1c06-9f6b-44b7-b38e-52bd361c96dd tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-6fc1cb4f-fb69-470c-890e-d5c55912d9a3 req-74ec1c06-9f6b-44b7-b38e-52bd361c96dd tempest-TestInstancesWithCinderVolumes-1283372801 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-01a8d931-4448-4d3c-be88-c70ac854d4dd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93aaa090-087f-400f-9757-0058b21bbc13', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:51:49 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:51:49 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-6fc1cb4f-fb69-470c-890e-d5c55912d9a3 req-74ec1c06-9f6b-44b7-b38e-52bd361c96dd tempest-TestInstancesWithCinderVolumes-1283372801 None] attachment_update completed successfully. Sep 07 13:51:49 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.355s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:51:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Deleted volume successfully. Sep 07 13:51:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e76534b-9421-4586-b7b3-d5a34e60a4d7 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-01ae2ac7-85ab-4964-bf0a-dfebd31fbeb7-delete_volume" released by "delete_volume" :: held 8.781s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:50 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.397s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:50 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:51:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Deleted volume successfully. Sep 07 13:51:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c6323515-2379-45cd-91f6-92fbeaad7b95 tempest-VolumeSnapshotQuotasNegativeTestJSON-9223279 None] Lock "cinder-a746ec41-053e-471c-996a-791322e6a3dd-delete_volume" released by "delete_volume" :: held 1.872s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Flow 'volume_create_manager' (19a36cab-5dd5-46ad-a312-555fa6eb206c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dedd1a08-ac79-4f1c-887c-828bed6d5099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dedd1a08-ac79-4f1c-887c-828bed6d5099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-644693237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6395fea5-bdbd-4053-9c70-1efb263b7420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40cd2d45a145678e914a082e703705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:51Z,use_quota=True,user_id='cd6bbffbc1ff47f993d7ae591aa12d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d7324f-bf26-4310-a09e-7a8ca7590d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5d7324f-bf26-4310-a09e-7a8ca7590d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9386b81-7311-4494-a604-d1f8c7dd10ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9386b81-7311-4494-a604-d1f8c7dd10ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6395fea5-bdbd-4053-9c70-1efb263b7420', 'volume_name': 'volume-6395fea5-bdbd-4053-9c70-1efb263b7420', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb415f7-5d58-4a48-9c85-bcec98b9a71a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb415f7-5d58-4a48-9c85-bcec98b9a71a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf6ab91-1ee0-4ab5-85c9-de25141f481d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:51 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Volume 6395fea5-bdbd-4053-9c70-1efb263b7420: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6395fea5-bdbd-4053-9c70-1efb263b7420', 'volume_size': 1} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-644693237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6395fea5-bdbd-4053-9c70-1efb263b7420,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40cd2d45a145678e914a082e703705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:51Z,use_quota=True,user_id='cd6bbffbc1ff47f993d7ae591aa12d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Creating volume 6395fea5-bdbd-4053-9c70-1efb263b7420 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:51 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:51:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:51 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 1073741824 Sep 07 13:51:51 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:51 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 1073741824" returned: 0 in 0.651s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:52 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 Sep 07 13:51:52 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:52 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420" returned: 0 in 0.308s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:51:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdf6ab91-1ee0-4ab5-85c9-de25141f481d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6395fea5-bdbd-4053-9c70-1efb263b7420', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72bd1ae6-d2a4-47d7-9722-e57f58f72bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:52 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Volume volume-6395fea5-bdbd-4053-9c70-1efb263b7420 (6395fea5-bdbd-4053-9c70-1efb263b7420): created successfully Sep 07 13:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72bd1ae6-d2a4-47d7-9722-e57f58f72bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Flow 'volume_create_manager' (19a36cab-5dd5-46ad-a312-555fa6eb206c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fff8ab5f-a2ee-43a2-b3c0-586145cb8b19 tempest-VolumesDeleteCascade-1725989864 None] Created volume successfully. Sep 07 13:51:53 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=81,cinder:INSERT=20,cinder:UPDATE=59,cinder:DELETE=4 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:51:53 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=68,cinder:SELECT=70,cinder:DELETE=8,cinder:INSERT=18 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:51:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-0697ffad-11df-4152-ad3f-cc5a04c51a88 req-cccd5b3f-f6e3-4089-9b26-1a9d1ef684e5 tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-0697ffad-11df-4152-ad3f-cc5a04c51a88 req-cccd5b3f-f6e3-4089-9b26-1a9d1ef684e5 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-0697ffad-11df-4152-ad3f-cc5a04c51a88 req-cccd5b3f-f6e3-4089-9b26-1a9d1ef684e5 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-0697ffad-11df-4152-ad3f-cc5a04c51a88 req-cccd5b3f-f6e3-4089-9b26-1a9d1ef684e5 tempest-TestInstancesWithCinderVolumes-1283372801 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-b8e823d3-2ccb-4138-8516-c9fe9390b045', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6d02694-9165-402b-b463-d6f2a0492c7e', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:51:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-0697ffad-11df-4152-ad3f-cc5a04c51a88 req-cccd5b3f-f6e3-4089-9b26-1a9d1ef684e5 tempest-TestInstancesWithCinderVolumes-1283372801 None] attachment_update completed successfully. Sep 07 13:51:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] Creating offline snapshot 705a0be2-93c1-45ef-b671-9ad2db271f5e of volume 6395fea5-bdbd-4053-9c70-1efb263b7420 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:51:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cb0d4b1-001a-4fb2-9d1f-b508ff88897a]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:54 devstack sudo[97471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 Sep 07 13:51:54 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:54 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420" returned: 0 in 0.631s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:54 devstack sudo[97476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e 1G Sep 07 13:51:54 devstack sudo[97476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:54 devstack sudo[97476]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e 1G" returned: 0 in 0.531s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6395fea5-bdbd-4053-9c70-1efb263b7420 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:54 devstack sudo[97498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6395fea5-bdbd-4053-9c70-1efb263b7420 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e Sep 07 13:51:54 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:55 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6395fea5-bdbd-4053-9c70-1efb263b7420 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e" returned: 0 in 0.365s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:55 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e is being set with open permissions: ugo+rw Sep 07 13:51:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:55 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e Sep 07 13:51:55 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:55 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e" returned: 0 in 0.284s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:55 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.info Sep 07 13:51:55 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:55 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.info" returned: 0 in 0.304s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:55 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.info is being set with open permissions: ugo+rw Sep 07 13:51:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:55 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.info Sep 07 13:51:55 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:56 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.info" returned: 0 in 0.267s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.491s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:56 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d5727e63-9deb-4fee-87d4-42cc95219167 tempest-VolumesDeleteCascade-1725989864 None] Create snapshot completed successfully Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Flow 'volume_create_manager' (820b3031-e7b0-4b4a-b4d9-6cf43910edd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd95517c-23ff-4b71-930a-8237a82f051d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd95517c-23ff-4b71-930a-8237a82f051d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1836052053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b667d585-98d8-4832-ad5f-aa0183c3b0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa40cd2d45a145678e914a082e703705',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=705a0be2-93c1-45ef-b671-9ad2db271f5e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:57Z,use_quota=True,user_id='cd6bbffbc1ff47f993d7ae591aa12d1d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc06e84-89f3-4ca5-ad2b-1086370364a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc06e84-89f3-4ca5-ad2b-1086370364a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5506b138-0238-4959-b042-06fc58362482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5506b138-0238-4959-b042-06fc58362482) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b667d585-98d8-4832-ad5f-aa0183c3b0ac', 'volume_name': 'volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac', 'volume_size': 1, 'snapshot_id': '705a0be2-93c1-45ef-b671-9ad2db271f5e'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bced8a86-4872-45c9-b70c-f7d70855ac44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bced8a86-4872-45c9-b70c-f7d70855ac44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff50b53d-b504-42af-942d-e7b9d01159ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:57 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Volume b667d585-98d8-4832-ad5f-aa0183c3b0ac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac', 'volume_size': 1, 'snapshot_id': '705a0be2-93c1-45ef-b671-9ad2db271f5e'} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-quobyte-705a0be2-93c1-45ef-b671-9ad2db271f5e-b667d585-98d8-4832-ad5f-aa0183c3b0ac" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-705a0be2-93c1-45ef-b671-9ad2db271f5e-b667d585-98d8-4832-ad5f-aa0183c3b0ac" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Creating volume b667d585-98d8-4832-ad5f-aa0183c3b0ac from snapshot 705a0be2-93c1-45ef-b671-9ad2db271f5e {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-quobyte-b667d585-98d8-4832-ad5f-aa0183c3b0ac" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-b667d585-98d8-4832-ad5f-aa0183c3b0ac" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] snapshot: 705a0be2-93c1-45ef-b671-9ad2db271f5e, volume: b667d585-98d8-4832-ad5f-aa0183c3b0ac, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5db213e-ec5e-4da2-80cb-3ef65c3e3526]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:57 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e Sep 07 13:51:57 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:58 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e" returned: 0 in 0.436s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6395fea5-bdbd-4053-9c70-1efb263b7420(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7cadc47-df0d-4cd1-b40d-2fb3ce953371]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:58 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 Sep 07 13:51:58 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:58 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420" returned: 0 in 0.386s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] will copy from snapshot at /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Path /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:51:58 devstack sudo[97555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac Sep 07 13:51:58 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Flow 'volume_create_manager' (d9afa39e-93b1-4d8e-9d6b-8d3b1eba045e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af020fb4-9e4e-47ed-9d28-fadf18de4539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af020fb4-9e4e-47ed-9d28-fadf18de4539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1608054299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ff8404-5738-4a75-a80b-85ded7493b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af255718028b482285cea04c54d171a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:59Z,use_quota=True,user_id='ea422c80ec5e48c6a5f0fda3592bffee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3543c705-9ff4-4385-84eb-e84a7587990a),volume_type_id=3543c705-9ff4-4385-84eb-e84a7587990a)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55474e98-ab4b-4185-9766-874c8f88b7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55474e98-ab4b-4185-9766-874c8f88b7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e54bcb9-358c-4f4a-b307-b1c0e6905431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e54bcb9-358c-4f4a-b307-b1c0e6905431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7ff8404-5738-4a75-a80b-85ded7493b6f', 'volume_name': 'volume-a7ff8404-5738-4a75-a80b-85ded7493b6f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3726aa7c-b86c-409f-96d5-71738ab573d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3726aa7c-b86c-409f-96d5-71738ab573d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f3b841b-8aad-44a1-92eb-e96e934b2c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:51:58 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Volume a7ff8404-5738-4a75-a80b-85ded7493b6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7ff8404-5738-4a75-a80b-85ded7493b6f', 'volume_size': 1} Sep 07 13:51:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:51:59 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-450dd188-0310-4cb0-89f1-1b13c7767660 req-02228520-4aae-4e0c-bc6c-a431a119df01 tempest-TestInstancesWithCinderVolumes-1283372801 None] Terminate volume connection completed successfully. Sep 07 13:51:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-450dd188-0310-4cb0-89f1-1b13c7767660 req-02228520-4aae-4e0c-bc6c-a431a119df01 tempest-TestInstancesWithCinderVolumes-1283372801 None] Deleting attachment 93aaa090-087f-400f-9757-0058b21bbc13. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:52:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "cinder-01a8d931-4448-4d3c-be88-c70ac854d4dd-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "cinder-01a8d931-4448-4d3c-be88-c70ac854d4dd-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "cinder-quobyte-01a8d931-4448-4d3c-be88-c70ac854d4dd" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "cinder-quobyte-01a8d931-4448-4d3c-be88-c70ac854d4dd" acquired by "delete_volume" :: waited 0.044s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c717de1-6292-450f-b2fe-df0bec5eb252]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01a8d931-4448-4d3c-be88-c70ac854d4dd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:01 devstack sudo[97576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01a8d931-4448-4d3c-be88-c70ac854d4dd Sep 07 13:52:01 devstack sudo[97576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:01 devstack sudo[97576]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01a8d931-4448-4d3c-be88-c70ac854d4dd" returned: 0 in 0.834s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01a8d931-4448-4d3c-be88-c70ac854d4dd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:01 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01a8d931-4448-4d3c-be88-c70ac854d4dd Sep 07 13:52:01 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:02 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-01a8d931-4448-4d3c-be88-c70ac854d4dd" returned: 0 in 0.530s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "cinder-quobyte-01a8d931-4448-4d3c-be88-c70ac854d4dd" released by "delete_volume" :: held 1.500s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:02 devstack cinder-volume[87444]: WARNING cinder.quota [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-663174211-1751029486 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-663174211-1751029486, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:52:02 devstack cinder-volume[87444]: WARNING cinder.quota [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-663174211-1751029486 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-663174211-1751029486, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:52:02 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Created reservations ['0fbaade7-770e-41a6-98cb-a5121fa55d3f', 'eeedb077-1b44-4d27-ae9a-e4ecb42a0ce8', '95deafc9-28a4-4858-a876-05836b165d7a', 'ee10c784-471f-4404-ab62-c1b7f6c280dc'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:02 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:52:02 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:03 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.489s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:03 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:03 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Deleted volume successfully. Sep 07 13:52:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6ffa5b5b-7e5b-422f-b614-0acdb7d8a600 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "cinder-01a8d931-4448-4d3c-be88-c70ac854d4dd-delete_volume" released by "delete_volume" :: held 2.584s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:04 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac" returned: 0 in 5.879s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Image conversion details: src /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:52:04 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Converted 1024.00 MB image at 174.15 MB/s Sep 07 13:52:04 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac is being set with open permissions: ugo+rw Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:04 devstack sudo[97601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac Sep 07 13:52:04 devstack sudo[97601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:04 devstack sudo[97601]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac" returned: 0 in 0.253s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-b667d585-98d8-4832-ad5f-aa0183c3b0ac" released by "_copy_volume_from_snapshot" :: held 7.052s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-705a0be2-93c1-45ef-b671-9ad2db271f5e-b667d585-98d8-4832-ad5f-aa0183c3b0ac" released by "_create_volume_from_snapshot" :: held 7.136s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.159s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.822s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1608054299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7ff8404-5738-4a75-a80b-85ded7493b6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af255718028b482285cea04c54d171a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:51:59Z,use_quota=True,user_id='ea422c80ec5e48c6a5f0fda3592bffee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3543c705-9ff4-4385-84eb-e84a7587990a),volume_type_id=3543c705-9ff4-4385-84eb-e84a7587990a)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Creating volume a7ff8404-5738-4a75-a80b-85ded7493b6f {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:04 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7ff8404-5738-4a75-a80b-85ded7493b6f 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:04 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7ff8404-5738-4a75-a80b-85ded7493b6f 1073741824 Sep 07 13:52:04 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff50b53d-b504-42af-942d-e7b9d01159ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac', 'volume_size': 1, 'snapshot_id': '705a0be2-93c1-45ef-b671-9ad2db271f5e'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73408b90-aaa5-43e1-b5ea-1dfdefd3aefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:04 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Volume volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac (b667d585-98d8-4832-ad5f-aa0183c3b0ac): created successfully Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73408b90-aaa5-43e1-b5ea-1dfdefd3aefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Flow 'volume_create_manager' (820b3031-e7b0-4b4a-b4d9-6cf43910edd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e4bc6b20-e62a-47d0-9c2f-3095ec275385 tempest-VolumesDeleteCascade-1725989864 None] Created volume successfully. Sep 07 13:52:05 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7ff8404-5738-4a75-a80b-85ded7493b6f 1073741824" returned: 0 in 0.586s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7ff8404-5738-4a75-a80b-85ded7493b6f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:05 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7ff8404-5738-4a75-a80b-85ded7493b6f Sep 07 13:52:05 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-6395fea5-bdbd-4053-9c70-1efb263b7420-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-6395fea5-bdbd-4053-9c70-1efb263b7420-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Performing cascade delete. {{(pid=87444) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-705a0be2-93c1-45ef-b671-9ad2db271f5e-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-705a0be2-93c1-45ef-b671-9ad2db271f5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-quobyte-6395fea5-bdbd-4053-9c70-1efb263b7420" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-6395fea5-bdbd-4053-9c70-1efb263b7420" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-quobyte-705a0be2-93c1-45ef-b671-9ad2db271f5e" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-705a0be2-93c1-45ef-b671-9ad2db271f5e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Deleting offline snapshot 705a0be2-93c1-45ef-b671-9ad2db271f5e of volume 6395fea5-bdbd-4053-9c70-1efb263b7420 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] snapshot_file for this snap is: volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:52:05 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7ff8404-5738-4a75-a80b-85ded7493b6f" returned: 0 in 0.370s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[270a24f3-f221-4510-9b9d-e55421514896]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f3b841b-8aad-44a1-92eb-e96e934b2c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7ff8404-5738-4a75-a80b-85ded7493b6f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c106871-17c0-40c3-9eab-0a9ccd4d09db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:05 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Volume volume-a7ff8404-5738-4a75-a80b-85ded7493b6f (a7ff8404-5738-4a75-a80b-85ded7493b6f): created successfully Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c106871-17c0-40c3-9eab-0a9ccd4d09db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Flow 'volume_create_manager' (d9afa39e-93b1-4d8e-9d6b-8d3b1eba045e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:05 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1251060a-6abb-42fa-ac68-041c8019c5e3 tempest-VolumeTypesAccessTest-581604107 None] Created volume successfully. Sep 07 13:52:05 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e Sep 07 13:52:05 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-e0c8e5a7-2474-4377-a282-7654fc9ad753 req-5667a005-7594-46dd-a864-4dac96b38b33 tempest-TestInstancesWithCinderVolumes-1283372801 None] Terminate volume connection completed successfully. Sep 07 13:52:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-e0c8e5a7-2474-4377-a282-7654fc9ad753 req-5667a005-7594-46dd-a864-4dac96b38b33 tempest-TestInstancesWithCinderVolumes-1283372801 None] Deleting attachment a6d02694-9165-402b-b463-d6f2a0492c7e. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:52:06 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e" returned: 0 in 0.432s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6395fea5-bdbd-4053-9c70-1efb263b7420(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:52:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a43af83-faac-4679-99d9-c23b1e09a23e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:06 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 Sep 07 13:52:06 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "cinder-b8e823d3-2ccb-4138-8516-c9fe9390b045-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "cinder-b8e823d3-2ccb-4138-8516-c9fe9390b045-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "cinder-quobyte-b8e823d3-2ccb-4138-8516-c9fe9390b045" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "cinder-quobyte-b8e823d3-2ccb-4138-8516-c9fe9390b045" acquired by "delete_volume" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca964d0-3b41-484d-97f1-7159209862dc]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b8e823d3-2ccb-4138-8516-c9fe9390b045 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Acquiring lock "cinder-a7ff8404-5738-4a75-a80b-85ded7493b6f-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:06 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420" returned: 0 in 0.675s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Lock "cinder-a7ff8404-5738-4a75-a80b-85ded7493b6f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:07 devstack sudo[97640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e Sep 07 13:52:07 devstack sudo[97640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Acquiring lock "cinder-quobyte-a7ff8404-5738-4a75-a80b-85ded7493b6f" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Lock "cinder-quobyte-a7ff8404-5738-4a75-a80b-85ded7493b6f" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e2b6f7-be36-4667-853e-fab001c2bce8]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7ff8404-5738-4a75-a80b-85ded7493b6f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:07 devstack sudo[97639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b8e823d3-2ccb-4138-8516-c9fe9390b045 Sep 07 13:52:07 devstack sudo[97639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:07 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7ff8404-5738-4a75-a80b-85ded7493b6f Sep 07 13:52:07 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:07 devstack sudo[97639]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b8e823d3-2ccb-4138-8516-c9fe9390b045" returned: 0 in 0.670s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b8e823d3-2ccb-4138-8516-c9fe9390b045 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:07 devstack sudo[97663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b8e823d3-2ccb-4138-8516-c9fe9390b045 Sep 07 13:52:07 devstack sudo[97663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:07 devstack sudo[97640]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e" returned: 0 in 0.705s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:07 devstack sudo[97672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e Sep 07 13:52:07 devstack sudo[97672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:07 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7ff8404-5738-4a75-a80b-85ded7493b6f" returned: 0 in 0.704s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7ff8404-5738-4a75-a80b-85ded7493b6f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:07 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7ff8404-5738-4a75-a80b-85ded7493b6f Sep 07 13:52:07 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:08 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7ff8404-5738-4a75-a80b-85ded7493b6f" returned: 0 in 0.373s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Lock "cinder-quobyte-a7ff8404-5738-4a75-a80b-85ded7493b6f" released by "delete_volume" :: held 1.157s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:08 devstack sudo[97663]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b8e823d3-2ccb-4138-8516-c9fe9390b045" returned: 0 in 0.676s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "cinder-quobyte-b8e823d3-2ccb-4138-8516-c9fe9390b045" released by "delete_volume" :: held 1.424s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:08 devstack sudo[97672]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:08 devstack cinder-volume[87444]: WARNING cinder.quota [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1019823183 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1019823183, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:52:08 devstack cinder-volume[87444]: WARNING cinder.quota [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1019823183 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1019823183, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420.705a0be2-93c1-45ef-b671-9ad2db271f5e" returned: 0 in 0.634s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-705a0be2-93c1-45ef-b671-9ad2db271f5e" released by "_delete_snapshot" :: held 2.572s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:08 devstack cinder-volume[87444]: WARNING cinder.quota [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1893155023-1745592019 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1893155023-1745592019, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:52:08 devstack cinder-volume[87444]: WARNING cinder.quota [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1893155023-1745592019 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1893155023-1745592019, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-6395fea5-bdbd-4053-9c70-1efb263b7420" released by "delete_snapshot" :: held 2.610s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Created reservations ['9cb65147-a5b3-4613-8214-be514611cf86', '8a839b27-858b-49a5-bf11-e9d639490bf0', 'f717fa8f-2c80-4bbb-b58a-be3387cd7b2b', 'd9e50477-3180-4b61-986a-2126b2c05386'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Created reservations ['f4a2269a-53b7-4a4f-aac8-13367c62854e', 'cc92fa04-85b0-40c4-9950-2a1b6b47f767', 'f5098ded-6f19-4be4-90cd-b71a462aaf42', 'aea3883d-d17c-42a0-9f21-00eb9e969efe'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:08 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:52:08 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Created reservations ['a092ba5b-9d22-4324-93fb-583747e2e34f', 'a34148db-87ae-451d-9450-50e9e88690c5', '0e385132-b82d-45f0-aef5-91ba230e23e6', 'ef1081cf-46fa-4052-8ceb-46d553b6b35d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:08 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:52:08 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Delete snapshot completed successfully. Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-705a0be2-93c1-45ef-b671-9ad2db271f5e-delete_snapshot" released by "delete_snapshot" :: held 3.097s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Snapshots deleted, issuing volume delete {{(pid=87444) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-quobyte-6395fea5-bdbd-4053-9c70-1efb263b7420" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-6395fea5-bdbd-4053-9c70-1efb263b7420" acquired by "delete_volume" :: waited 0.056s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:08 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.425s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:08 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0c43e4-8e3a-421d-b13b-c635962302c9]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Deleted volume successfully. Sep 07 13:52:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d775f3e-2b0e-457a-9a5f-eaadb25d4fe7 tempest-VolumeTypesAccessTest-581604107 None] Lock "cinder-a7ff8404-5738-4a75-a80b-85ded7493b6f-delete_volume" released by "delete_volume" :: held 2.145s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:09 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 Sep 07 13:52:09 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:09 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.695s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:09 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Deleted volume successfully. Sep 07 13:52:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c633cc1-f69e-4934-b5a6-f0c3adc17370 tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "cinder-b8e823d3-2ccb-4138-8516-c9fe9390b045-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:09 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420" returned: 0 in 0.662s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:09 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420 Sep 07 13:52:09 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:10 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-6395fea5-bdbd-4053-9c70-1efb263b7420" returned: 0 in 0.408s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-6395fea5-bdbd-4053-9c70-1efb263b7420" released by "delete_volume" :: held 1.218s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:10 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Created reservations ['06e5564c-3933-404c-812e-fc5807772530', '3f810f7b-6cc2-42c0-8d94-b949cc4a75a3', 'a164d466-ade0-4483-88a7-caf67aa5f211', '1d488f90-be9b-4c86-8d2b-b6154135c3ed'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:10 devstack sudo[97716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:52:10 devstack sudo[97716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:10 devstack sudo[97716]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.425s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:10 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Deleted volume successfully. Sep 07 13:52:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4bf5fd31-3238-4ec4-91e3-59d2cba53acb tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-6395fea5-bdbd-4053-9c70-1efb263b7420-delete_volume" released by "delete_volume" :: held 5.212s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-b667d585-98d8-4832-ad5f-aa0183c3b0ac-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-b667d585-98d8-4832-ad5f-aa0183c3b0ac-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "cinder-quobyte-b667d585-98d8-4832-ad5f-aa0183c3b0ac" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-b667d585-98d8-4832-ad5f-aa0183c3b0ac" acquired by "delete_volume" :: waited 0.068s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:11 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0298fe1-38a3-432e-9641-19d31e119d0b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:12 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac Sep 07 13:52:12 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:12 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac" returned: 0 in 0.502s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:12 devstack sudo[97732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac Sep 07 13:52:12 devstack sudo[97732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:12 devstack sudo[97732]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b667d585-98d8-4832-ad5f-aa0183c3b0ac" returned: 0 in 0.462s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-quobyte-b667d585-98d8-4832-ad5f-aa0183c3b0ac" released by "delete_volume" :: held 1.062s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:13 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Created reservations ['0aff6634-38f1-4b4f-865f-c4476c2d2264', '8b73b6f9-9988-48b7-a0bc-fd345f219c34', '9cda28e9-0931-4f37-80ae-7c0fd00a14d9', '2c457263-bbe7-4370-a59f-e755c91ed61c'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:13 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:52:13 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:13 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.343s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:13 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:13 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Deleted volume successfully. Sep 07 13:52:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4c82bac2-443a-4ee4-8f6c-040038870796 tempest-VolumesDeleteCascade-1725989864 None] Lock "cinder-b667d585-98d8-4832-ad5f-aa0183c3b0ac-delete_volume" released by "delete_volume" :: held 1.845s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-88cf89b1-2e3f-491f-92c5-9685a0661e50 req-45d63d0c-3867-4a27-b2b7-2f03bc29c33f tempest-TestInstancesWithCinderVolumes-1283372801 None] Terminate volume connection completed successfully. Sep 07 13:52:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-88cf89b1-2e3f-491f-92c5-9685a0661e50 req-45d63d0c-3867-4a27-b2b7-2f03bc29c33f tempest-TestInstancesWithCinderVolumes-1283372801 None] Deleting attachment 227fe783-0bf5-4c41-b162-b5996493b400. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:52:16 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-e4683ceb-a1df-4fcb-a747-21cd1d1883cd req-c00ef006-6ae0-45fc-a58a-fc691ec352d6 tempest-AttachVolumeNegativeTest-257270736 None] Terminate volume connection completed successfully. Sep 07 13:52:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-e4683ceb-a1df-4fcb-a747-21cd1d1883cd req-c00ef006-6ae0-45fc-a58a-fc691ec352d6 tempest-AttachVolumeNegativeTest-257270736 None] Deleting attachment 5d3c841f-6973-4f30-9056-a8e5bfc8f252. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:52:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "cinder-94d911fe-e3ef-449f-a7b6-b0c05dfcce67-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "cinder-94d911fe-e3ef-449f-a7b6-b0c05dfcce67-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "cinder-quobyte-94d911fe-e3ef-449f-a7b6-b0c05dfcce67" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "cinder-quobyte-94d911fe-e3ef-449f-a7b6-b0c05dfcce67" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:17 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f505de0e-e785-4181-a800-5e30fce9b651]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:17 devstack sudo[97765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67 Sep 07 13:52:17 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:17 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67" returned: 0 in 0.598s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:17 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67 Sep 07 13:52:17 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:18 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94d911fe-e3ef-449f-a7b6-b0c05dfcce67" returned: 0 in 0.423s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "cinder-quobyte-94d911fe-e3ef-449f-a7b6-b0c05dfcce67" released by "delete_volume" :: held 1.087s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:18 devstack cinder-volume[87444]: WARNING cinder.quota [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-763199024-591753936 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-763199024-591753936, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:52:18 devstack cinder-volume[87444]: WARNING cinder.quota [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-763199024-591753936 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-763199024-591753936, it is now deprecated. Please use the default quota class for default quota. Sep 07 13:52:18 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Created reservations ['55b11ceb-80e1-49e0-a90b-d17ef38115e1', 'a4fe0c11-dc70-4398-bb3f-4b745115e05e', 'b45e4e3a-1b7a-4c18-ab7f-1a87e07b7767', '011b5cc6-247c-4449-a238-8312ef52772e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:18 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:52:18 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:18 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.478s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:18 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Deleted volume successfully. Sep 07 13:52:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2fdf554-be91-4947-9e00-5023074251dc tempest-TestInstancesWithCinderVolumes-1283372801 None] Lock "cinder-94d911fe-e3ef-449f-a7b6-b0c05dfcce67-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Flow 'volume_create_manager' (d911244a-27e1-49e7-a506-8529295ef805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0cc8d71-eae4-4385-8046-83141d0e0ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0cc8d71-eae4-4385-8046-83141d0e0ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-994337596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53105339-e1a4-4481-8df0-3b862859e244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a73c7648522e4b34b5a4eb5ae30b9cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:20Z,use_quota=True,user_id='219e317de25f4900a4a1620309d3b91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329bcede-3e9d-4ba8-9be1-421bf2f5087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (329bcede-3e9d-4ba8-9be1-421bf2f5087b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073da832-6e01-4599-82ea-cce9b542dce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (073da832-6e01-4599-82ea-cce9b542dce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53105339-e1a4-4481-8df0-3b862859e244', 'volume_name': 'volume-53105339-e1a4-4481-8df0-3b862859e244', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9eca2c1-b6b7-43ca-ae27-e03e3f473722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9eca2c1-b6b7-43ca-ae27-e03e3f473722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ce4088-4cbc-4694-b178-70925b64b212) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:20 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Volume 53105339-e1a4-4481-8df0-3b862859e244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53105339-e1a4-4481-8df0-3b862859e244', 'volume_size': 1} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-994337596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53105339-e1a4-4481-8df0-3b862859e244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a73c7648522e4b34b5a4eb5ae30b9cab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:20Z,use_quota=True,user_id='219e317de25f4900a4a1620309d3b91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Creating volume 53105339-e1a4-4481-8df0-3b862859e244 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:20 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:52:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-53105339-e1a4-4481-8df0-3b862859e244 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:20 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-53105339-e1a4-4481-8df0-3b862859e244 1073741824 Sep 07 13:52:20 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Flow 'volume_create_manager' (0675b75b-aa3a-4a65-ae36-34d30e45d103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc728cbd-adb9-436f-892e-26cd4871b0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc728cbd-adb9-436f-892e-26cd4871b0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-291503185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c6510c-924c-4fb5-be64-da3f60d0f026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e051e5b697448b8f09dcd6cd000b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:21Z,use_quota=True,user_id='5ff5acd9d4c041fe8e06337312bcf125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b68840-d739-4b8e-922e-1f5eb595226c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69b68840-d739-4b8e-922e-1f5eb595226c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd5a955-68d0-4050-ac81-c1f1d8751b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cd5a955-68d0-4050-ac81-c1f1d8751b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98c6510c-924c-4fb5-be64-da3f60d0f026', 'volume_name': 'volume-98c6510c-924c-4fb5-be64-da3f60d0f026', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eaea497-5804-445e-9d58-0394f17962ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8eaea497-5804-445e-9d58-0394f17962ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d6cf7c-a0cf-4511-9443-0b4d8b37acc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:21 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Volume 98c6510c-924c-4fb5-be64-da3f60d0f026: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98c6510c-924c-4fb5-be64-da3f60d0f026', 'volume_size': 1} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:21 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-53105339-e1a4-4481-8df0-3b862859e244 1073741824" returned: 0 in 0.705s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-53105339-e1a4-4481-8df0-3b862859e244 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:21 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-53105339-e1a4-4481-8df0-3b862859e244 Sep 07 13:52:21 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:21 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-53105339-e1a4-4481-8df0-3b862859e244" returned: 0 in 0.320s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.435s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-291503185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98c6510c-924c-4fb5-be64-da3f60d0f026,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e051e5b697448b8f09dcd6cd000b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:21Z,use_quota=True,user_id='5ff5acd9d4c041fe8e06337312bcf125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Creating volume 98c6510c-924c-4fb5-be64-da3f60d0f026 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:21 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98c6510c-924c-4fb5-be64-da3f60d0f026 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:21 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98c6510c-924c-4fb5-be64-da3f60d0f026 1073741824 Sep 07 13:52:21 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10ce4088-4cbc-4694-b178-70925b64b212) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53105339-e1a4-4481-8df0-3b862859e244', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4bfff6c-d656-4570-9d4c-cc7ff70026f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:21 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Volume volume-53105339-e1a4-4481-8df0-3b862859e244 (53105339-e1a4-4481-8df0-3b862859e244): created successfully Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4bfff6c-d656-4570-9d4c-cc7ff70026f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Flow 'volume_create_manager' (d911244a-27e1-49e7-a506-8529295ef805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-05f8bdaf-7152-41a1-95b9-42b803c22e8b tempest-VolumesMetadataTest-1366629418 None] Created volume successfully. Sep 07 13:52:22 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98c6510c-924c-4fb5-be64-da3f60d0f026 1073741824" returned: 0 in 0.605s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98c6510c-924c-4fb5-be64-da3f60d0f026 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:22 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98c6510c-924c-4fb5-be64-da3f60d0f026 Sep 07 13:52:22 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:22 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98c6510c-924c-4fb5-be64-da3f60d0f026" returned: 0 in 0.343s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:52:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d6cf7c-a0cf-4511-9443-0b4d8b37acc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98c6510c-924c-4fb5-be64-da3f60d0f026', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f369ad71-806d-4005-913f-d0ea76b37fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:22 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Volume volume-98c6510c-924c-4fb5-be64-da3f60d0f026 (98c6510c-924c-4fb5-be64-da3f60d0f026): created successfully Sep 07 13:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f369ad71-806d-4005-913f-d0ea76b37fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Flow 'volume_create_manager' (0675b75b-aa3a-4a65-ae36-34d30e45d103) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fe60eeba-8fce-4806-8960-9e8492681ba6 tempest-VolumesListAdminTestJSON-1666788056 None] Created volume successfully. Sep 07 13:52:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Acquiring lock "cinder-53105339-e1a4-4481-8df0-3b862859e244-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Lock "cinder-53105339-e1a4-4481-8df0-3b862859e244-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Acquiring lock "cinder-quobyte-53105339-e1a4-4481-8df0-3b862859e244" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Lock "cinder-quobyte-53105339-e1a4-4481-8df0-3b862859e244" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0beb5d7-1b4e-43cc-a50b-23ba73d4a62e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-53105339-e1a4-4481-8df0-3b862859e244 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Flow 'volume_create_manager' (88098b06-0380-4e14-a40c-05f7dbd8d6da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2dee581-dddf-49e7-83a6-4c4ebf8b6fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:24 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-53105339-e1a4-4481-8df0-3b862859e244 Sep 07 13:52:24 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2dee581-dddf-49e7-83a6-4c4ebf8b6fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-798306458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc53b06-bf2f-4184-bfa4-d0ba6ff18225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e051e5b697448b8f09dcd6cd000b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:24Z,use_quota=True,user_id='5ff5acd9d4c041fe8e06337312bcf125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20861f1d-80b2-4dcf-832e-65a20faafdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20861f1d-80b2-4dcf-832e-65a20faafdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad4b28a-27a2-48e5-bf2f-39f81b27e513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ad4b28a-27a2-48e5-bf2f-39f81b27e513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddc53b06-bf2f-4184-bfa4-d0ba6ff18225', 'volume_name': 'volume-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0071645-c763-4cfb-8d4f-20ce8554c41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0071645-c763-4cfb-8d4f-20ce8554c41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385fcfc7-8bf2-417e-808b-9103a44f751b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:24 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Volume ddc53b06-bf2f-4184-bfa4-d0ba6ff18225: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225', 'volume_size': 1} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-798306458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddc53b06-bf2f-4184-bfa4-d0ba6ff18225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e051e5b697448b8f09dcd6cd000b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:24Z,use_quota=True,user_id='5ff5acd9d4c041fe8e06337312bcf125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Creating volume ddc53b06-bf2f-4184-bfa4-d0ba6ff18225 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:24 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:24 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225 1073741824 Sep 07 13:52:24 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:24 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-53105339-e1a4-4481-8df0-3b862859e244" returned: 0 in 0.556s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-53105339-e1a4-4481-8df0-3b862859e244 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:24 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-53105339-e1a4-4481-8df0-3b862859e244 Sep 07 13:52:24 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:24 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225 1073741824" returned: 0 in 0.588s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:24 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-53105339-e1a4-4481-8df0-3b862859e244" returned: 0 in 0.294s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Lock "cinder-quobyte-53105339-e1a4-4481-8df0-3b862859e244" released by "delete_volume" :: held 0.933s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:24 devstack sudo[97830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225 Sep 07 13:52:24 devstack sudo[97830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Created reservations ['07391b73-0f4d-4b65-ae4e-2a2f164d8bb5', 'ba53a13f-6b45-44ff-978c-0135d92243af', 'c6a69ecf-aa73-4c34-b3ba-330e3c600664', 'b7f40403-cd6c-4a43-817d-d0a4c7f3cae4'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:25 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:52:25 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:25 devstack sudo[97830]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225" returned: 0 in 0.365s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (385fcfc7-8bf2-417e-808b-9103a44f751b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e6d365-39cc-495d-8f0c-6d6208da9a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:25 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Volume volume-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225 (ddc53b06-bf2f-4184-bfa4-d0ba6ff18225): created successfully Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e6d365-39cc-495d-8f0c-6d6208da9a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Flow 'volume_create_manager' (88098b06-0380-4e14-a40c-05f7dbd8d6da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8cdde671-7799-493e-aa51-7296653b9cbc tempest-VolumesListAdminTestJSON-1666788056 None] Created volume successfully. Sep 07 13:52:25 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.396s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Deleted volume successfully. Sep 07 13:52:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc7f56a9-6e84-4e77-983d-4633765ca67c tempest-VolumesMetadataTest-1366629418 None] Lock "cinder-53105339-e1a4-4481-8df0-3b862859e244-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:26 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:52:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Flow 'volume_create_manager' (4f997cfc-5f8c-4092-a4f4-161177c9eb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a5b743-54a1-41b5-a890-dc558abb6dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0a5b743-54a1-41b5-a890-dc558abb6dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1945511670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1baf5ef6-218b-43ca-ac54-4ef712304e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e051e5b697448b8f09dcd6cd000b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:27Z,use_quota=True,user_id='5ff5acd9d4c041fe8e06337312bcf125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc0295e-73de-4132-89e5-80072a3e4446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc0295e-73de-4132-89e5-80072a3e4446) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5471340-3409-41f5-952e-f26f58ae8cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5471340-3409-41f5-952e-f26f58ae8cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1baf5ef6-218b-43ca-ac54-4ef712304e14', 'volume_name': 'volume-1baf5ef6-218b-43ca-ac54-4ef712304e14', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c536d74f-69b4-4f33-91c4-20998829eabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c536d74f-69b4-4f33-91c4-20998829eabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff383fc0-01b4-4a39-82fb-a5a5bf1a4095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:27 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Volume 1baf5ef6-218b-43ca-ac54-4ef712304e14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1baf5ef6-218b-43ca-ac54-4ef712304e14', 'volume_size': 1} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1945511670',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1baf5ef6-218b-43ca-ac54-4ef712304e14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e051e5b697448b8f09dcd6cd000b52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:27Z,use_quota=True,user_id='5ff5acd9d4c041fe8e06337312bcf125',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Creating volume 1baf5ef6-218b-43ca-ac54-4ef712304e14 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:27 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1baf5ef6-218b-43ca-ac54-4ef712304e14 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:27 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1baf5ef6-218b-43ca-ac54-4ef712304e14 1073741824 Sep 07 13:52:27 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:27 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1baf5ef6-218b-43ca-ac54-4ef712304e14 1073741824" returned: 0 in 0.777s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1baf5ef6-218b-43ca-ac54-4ef712304e14 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:27 devstack sudo[97846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1baf5ef6-218b-43ca-ac54-4ef712304e14 Sep 07 13:52:27 devstack sudo[97846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:28 devstack sudo[97846]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1baf5ef6-218b-43ca-ac54-4ef712304e14" returned: 0 in 0.387s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:52:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff383fc0-01b4-4a39-82fb-a5a5bf1a4095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1baf5ef6-218b-43ca-ac54-4ef712304e14', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78419d90-a364-47aa-b59e-39a4ce2c3d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:28 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Volume volume-1baf5ef6-218b-43ca-ac54-4ef712304e14 (1baf5ef6-218b-43ca-ac54-4ef712304e14): created successfully Sep 07 13:52:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78419d90-a364-47aa-b59e-39a4ce2c3d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Flow 'volume_create_manager' (4f997cfc-5f8c-4092-a4f4-161177c9eb8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f144294f-89b0-4add-91a7-6795e793ddc8 tempest-VolumesListAdminTestJSON-1666788056 None] Created volume successfully. Sep 07 13:52:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:52:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:29 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:52:29 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Flow 'volume_create_manager' (5c23ee11-be8d-4850-a4a8-31949aab4d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58417f2e-eaef-4a0c-a00f-3cf05d356b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58417f2e-eaef-4a0c-a00f-3cf05d356b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1820c9a-894e-4fbb-a4a4-6c30426f8f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd28c65a092747c287d3c5b6a40197aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:30Z,use_quota=True,user_id='9f3fd32ba4654ccaa28c1b885b53cacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c6e6e1-f79f-4823-8cc2-c5dac6aab8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:30 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58c6e6e1-f79f-4823-8cc2-c5dac6aab8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08297776-bc06-4b47-a140-fc8e32b45e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08297776-bc06-4b47-a140-fc8e32b45e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1820c9a-894e-4fbb-a4a4-6c30426f8f4f', 'volume_name': 'volume-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff81626-660d-4d50-ae19-b5af78cf1791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ff81626-660d-4d50-ae19-b5af78cf1791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874a75a1-7e7c-4fd6-a380-7dae2e1efad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:30 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Volume c1820c9a-894e-4fbb-a4a4-6c30426f8f4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f', 'volume_size': 1} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1820c9a-894e-4fbb-a4a4-6c30426f8f4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd28c65a092747c287d3c5b6a40197aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:30Z,use_quota=True,user_id='9f3fd32ba4654ccaa28c1b885b53cacd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Creating volume c1820c9a-894e-4fbb-a4a4-6c30426f8f4f {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:30 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.495s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:52:30 devstack sudo[97869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f 1073741824 Sep 07 13:52:30 devstack sudo[97869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:30 devstack sudo[97869]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f 1073741824" returned: 0 in 0.665s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:31 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f Sep 07 13:52:31 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:31 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f" returned: 0 in 0.315s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:52:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874a75a1-7e7c-4fd6-a380-7dae2e1efad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155bc19b-17f8-4ef1-9776-34458e583795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:31 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Volume volume-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f (c1820c9a-894e-4fbb-a4a4-6c30426f8f4f): created successfully Sep 07 13:52:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (155bc19b-17f8-4ef1-9776-34458e583795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Flow 'volume_create_manager' (5c23ee11-be8d-4850-a4a8-31949aab4d35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f2200fc9-ec12-494f-a4d8-eed5f58ce659 tempest-VolumesListAdminTestJSON-936582891 None] Created volume successfully. Sep 07 13:52:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Acquiring lock "cinder-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Lock "cinder-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Acquiring lock "cinder-quobyte-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Lock "cinder-quobyte-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:32 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d70b803-97b4-4265-aa5c-11e839d13658]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Acquiring lock "cinder-1baf5ef6-218b-43ca-ac54-4ef712304e14-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "cinder-1baf5ef6-218b-43ca-ac54-4ef712304e14-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Acquiring lock "cinder-quobyte-1baf5ef6-218b-43ca-ac54-4ef712304e14" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "cinder-quobyte-1baf5ef6-218b-43ca-ac54-4ef712304e14" acquired by "delete_volume" :: waited 0.040s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:33 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[755e97a2-9044-4654-a178-2ae51b4c91a7]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1baf5ef6-218b-43ca-ac54-4ef712304e14 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:33 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f Sep 07 13:52:33 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:33 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1baf5ef6-218b-43ca-ac54-4ef712304e14 Sep 07 13:52:33 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:33 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f" returned: 0 in 1.065s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:33 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f Sep 07 13:52:33 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:34 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1baf5ef6-218b-43ca-ac54-4ef712304e14" returned: 0 in 1.066s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1baf5ef6-218b-43ca-ac54-4ef712304e14 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:34 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1baf5ef6-218b-43ca-ac54-4ef712304e14 Sep 07 13:52:34 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:34 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f" returned: 0 in 0.621s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Lock "cinder-quobyte-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f" released by "delete_volume" :: held 1.846s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:34 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Created reservations ['af1e60be-b2c5-4792-9503-2996f61c6fbd', 'bec633b4-d90d-4357-a486-6e9ae79ab045', 'df616dd7-1574-453d-bebf-69e59a9e7652', '9661a4a0-643e-4793-bdb4-a3ff90e2c93e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:34 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1baf5ef6-218b-43ca-ac54-4ef712304e14" returned: 0 in 0.559s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "cinder-quobyte-1baf5ef6-218b-43ca-ac54-4ef712304e14" released by "delete_volume" :: held 1.804s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:34 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:52:34 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Created reservations ['6cc9ebe5-241c-4484-8c77-411e6ccdb71d', '8d7c26a0-59d9-47d1-b862-f86fba33811f', '34142f1b-c546-4e80-9eec-0f9457be0ccb', '7b6ae970-e2c9-404d-a2cd-a8d27ff40a15'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:35 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:52:35 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:52:35 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Flow 'volume_create_manager' (ca4b8e81-532d-4482-b046-11c569338f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af85296-8101-4d46-9bd2-3f6649671f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Acquiring lock "cinder-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af85296-8101-4d46-9bd2-3f6649671f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1465759458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e60ba10a-d021-42bd-af48-105b71ca6dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fc94c558fa49888311a1a40395661e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:35Z,use_quota=True,user_id='e1223905cfa84fdfbe73601ff6097d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c7ba59-1643-42a7-a9ce-35f9672d59d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7c7ba59-1643-42a7-a9ce-35f9672d59d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba44716a-7324-47b4-936a-b4284ea30433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba44716a-7324-47b4-936a-b4284ea30433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e60ba10a-d021-42bd-af48-105b71ca6dcc', 'volume_name': 'volume-e60ba10a-d021-42bd-af48-105b71ca6dcc', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ed1965-a340-41ff-af19-dda5120ea070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ed1965-a340-41ff-af19-dda5120ea070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fe2bae-5cd0-4cec-954e-ada64e0764c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:35 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Volume e60ba10a-d021-42bd-af48-105b71ca6dcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e60ba10a-d021-42bd-af48-105b71ca6dcc', 'volume_size': 1} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1465759458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e60ba10a-d021-42bd-af48-105b71ca6dcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fc94c558fa49888311a1a40395661e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:35Z,use_quota=True,user_id='e1223905cfa84fdfbe73601ff6097d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Creating volume e60ba10a-d021-42bd-af48-105b71ca6dcc {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:35 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60ba10a-d021-42bd-af48-105b71ca6dcc 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:35 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 1.005s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.618s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:35 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60ba10a-d021-42bd-af48-105b71ca6dcc 1073741824 Sep 07 13:52:35 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:35 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Deleted volume successfully. Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "cinder-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225-delete_volume" acquired by "delete_volume" :: waited 0.199s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:35 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Deleted volume successfully. Sep 07 13:52:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75dec1bf-f396-4003-acbe-712d8bac5be2 tempest-VolumesListAdminTestJSON-936582891 None] Lock "cinder-c1820c9a-894e-4fbb-a4a4-6c30426f8f4f-delete_volume" released by "delete_volume" :: held 3.458s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Acquiring lock "cinder-quobyte-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8990551d-b56a-48fb-98a7-73d690a593a6 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "cinder-1baf5ef6-218b-43ca-ac54-4ef712304e14-delete_volume" released by "delete_volume" :: held 3.262s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "cinder-quobyte-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225" acquired by "delete_volume" :: waited 0.052s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:36 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ed0659-88a5-4c94-b3eb-694d2c5fb96c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:36 devstack sudo[97976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225 Sep 07 13:52:36 devstack sudo[97976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:36 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60ba10a-d021-42bd-af48-105b71ca6dcc 1073741824" returned: 0 in 0.593s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60ba10a-d021-42bd-af48-105b71ca6dcc {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:36 devstack sudo[97981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60ba10a-d021-42bd-af48-105b71ca6dcc Sep 07 13:52:36 devstack sudo[97981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:36 devstack sudo[97976]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225" returned: 0 in 0.550s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:36 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225 Sep 07 13:52:36 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:36 devstack sudo[97981]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60ba10a-d021-42bd-af48-105b71ca6dcc" returned: 0 in 0.443s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:52:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.121s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fe2bae-5cd0-4cec-954e-ada64e0764c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e60ba10a-d021-42bd-af48-105b71ca6dcc', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e390ea89-1149-4258-b253-e37bed3a17ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:37 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Volume volume-e60ba10a-d021-42bd-af48-105b71ca6dcc (e60ba10a-d021-42bd-af48-105b71ca6dcc): created successfully Sep 07 13:52:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e390ea89-1149-4258-b253-e37bed3a17ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Flow 'volume_create_manager' (ca4b8e81-532d-4482-b046-11c569338f6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-78c9a0c3-c5e4-4615-90a8-91a8d145ad72 tempest-VolumesTransfersTest-278773506 None] Created volume successfully. Sep 07 13:52:37 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225" returned: 0 in 0.403s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "cinder-quobyte-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225" released by "delete_volume" :: held 1.066s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:37 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Created reservations ['bf3a5dad-de8a-49ad-b22f-d4a0bf1f847e', '21e4b6c5-bdf3-4816-800c-4124f251a51c', '680a3d86-afde-4e76-9aa6-770ff98395d5', '3dfde4eb-14ff-40f5-bdf7-f8ef161e0a1e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:37 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:52:37 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:37 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.492s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:37 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Deleted volume successfully. Sep 07 13:52:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-20fad7c0-bc10-402f-9403-3c1b11fe8671 tempest-VolumesListAdminTestJSON-1666788056 None] Lock "cinder-ddc53b06-bf2f-4184-bfa4-d0ba6ff18225-delete_volume" released by "delete_volume" :: held 2.068s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Acquiring lock "cinder-98c6510c-924c-4fb5-be64-da3f60d0f026-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Lock "cinder-98c6510c-924c-4fb5-be64-da3f60d0f026-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Acquiring lock "cinder-quobyte-98c6510c-924c-4fb5-be64-da3f60d0f026" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Lock "cinder-quobyte-98c6510c-924c-4fb5-be64-da3f60d0f026" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:38 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4276ed78-ebdf-4e83-bebd-9a9366b287e8]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98c6510c-924c-4fb5-be64-da3f60d0f026 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:38 devstack sudo[97994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98c6510c-924c-4fb5-be64-da3f60d0f026 Sep 07 13:52:38 devstack sudo[97994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:39 devstack sudo[97994]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98c6510c-924c-4fb5-be64-da3f60d0f026" returned: 0 in 0.712s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98c6510c-924c-4fb5-be64-da3f60d0f026 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:39 devstack sudo[98001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98c6510c-924c-4fb5-be64-da3f60d0f026 Sep 07 13:52:39 devstack sudo[98001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:39 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1b22e2e9-3c8e-4f5d-80b8-d64334dd5455 tempest-VolumesTransfersTest-1913570612 None] Transfer volume completed successfully. Sep 07 13:52:39 devstack sudo[98001]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98c6510c-924c-4fb5-be64-da3f60d0f026" returned: 0 in 0.561s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Lock "cinder-quobyte-98c6510c-924c-4fb5-be64-da3f60d0f026" released by "delete_volume" :: held 1.363s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:39 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Created reservations ['f20b58af-3154-4e82-a0d7-549ba902eeed', '63604f00-9b1e-455c-a3ab-fce629e5d4cf', '2c2ec215-317b-4779-8293-8c12ef143967', '68946fb0-7f9b-4207-b5bc-f1a6795ac65f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:40 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:52:40 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:40 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.420s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:40 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:40 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Deleted volume successfully. Sep 07 13:52:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-50e67bec-1d6d-4a8f-b7c4-4fe10c5df03b tempest-VolumesListAdminTestJSON-1666788056 None] Lock "cinder-98c6510c-924c-4fb5-be64-da3f60d0f026-delete_volume" released by "delete_volume" :: held 2.291s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Acquiring lock "cinder-e60ba10a-d021-42bd-af48-105b71ca6dcc-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Lock "cinder-e60ba10a-d021-42bd-af48-105b71ca6dcc-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Acquiring lock "cinder-quobyte-e60ba10a-d021-42bd-af48-105b71ca6dcc" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Lock "cinder-quobyte-e60ba10a-d021-42bd-af48-105b71ca6dcc" acquired by "delete_volume" :: waited 0.043s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c8a41f-e360-46b3-9dc1-598fedaf6a81]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60ba10a-d021-42bd-af48-105b71ca6dcc {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:40 devstack sudo[98010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60ba10a-d021-42bd-af48-105b71ca6dcc Sep 07 13:52:40 devstack sudo[98010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:41 devstack sudo[98010]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60ba10a-d021-42bd-af48-105b71ca6dcc" returned: 0 in 0.567s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60ba10a-d021-42bd-af48-105b71ca6dcc {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:41 devstack sudo[98049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60ba10a-d021-42bd-af48-105b71ca6dcc Sep 07 13:52:41 devstack sudo[98049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:42 devstack sudo[98049]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60ba10a-d021-42bd-af48-105b71ca6dcc" returned: 0 in 0.805s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Lock "cinder-quobyte-e60ba10a-d021-42bd-af48-105b71ca6dcc" released by "delete_volume" :: held 1.453s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:42 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Created reservations ['79fbb48e-a1c9-456f-a216-65a19295ca3c', '8d392277-cbbb-418f-ac10-8ce395dadeac', 'c240689a-8ff0-446e-acc4-537c52f90e21', '4ef5d317-b26e-427d-b59c-124ddea15d67'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:42 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:52:42 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:42 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.413s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:42 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Deleted volume successfully. Sep 07 13:52:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6eefb117-d30a-44ec-ad6a-89a0bab4920a tempest-VolumesTransfersTest-602771613 None] Lock "cinder-e60ba10a-d021-42bd-af48-105b71ca6dcc-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Flow 'volume_create_manager' (bf504e9b-520c-47af-b25a-81bec8732773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f19ab8-9d77-4ed6-a70d-bb83a4df4952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f19ab8-9d77-4ed6-a70d-bb83a4df4952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-454784668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9469289f-bdce-49ba-b89a-b23208581ecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fc94c558fa49888311a1a40395661e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:44Z,use_quota=True,user_id='e1223905cfa84fdfbe73601ff6097d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95d8a70-f8ba-4c24-b63d-b00720490260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f95d8a70-f8ba-4c24-b63d-b00720490260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a3d2b1-9ac6-49b8-a404-b798bb3328b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a3d2b1-9ac6-49b8-a404-b798bb3328b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9469289f-bdce-49ba-b89a-b23208581ecd', 'volume_name': 'volume-9469289f-bdce-49ba-b89a-b23208581ecd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330687ef-b64f-4dd2-b9bd-3c7da1e157cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (330687ef-b64f-4dd2-b9bd-3c7da1e157cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6e4fe2-4f4e-45af-b91c-1f984af23f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Volume 9469289f-bdce-49ba-b89a-b23208581ecd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9469289f-bdce-49ba-b89a-b23208581ecd', 'volume_size': 1} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-454784668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9469289f-bdce-49ba-b89a-b23208581ecd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33fc94c558fa49888311a1a40395661e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:44Z,use_quota=True,user_id='e1223905cfa84fdfbe73601ff6097d7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Creating volume 9469289f-bdce-49ba-b89a-b23208581ecd {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:44 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9469289f-bdce-49ba-b89a-b23208581ecd 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:44 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9469289f-bdce-49ba-b89a-b23208581ecd 1073741824 Sep 07 13:52:44 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:44 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9469289f-bdce-49ba-b89a-b23208581ecd 1073741824" returned: 0 in 0.639s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9469289f-bdce-49ba-b89a-b23208581ecd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:45 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9469289f-bdce-49ba-b89a-b23208581ecd Sep 07 13:52:45 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:45 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9469289f-bdce-49ba-b89a-b23208581ecd" returned: 0 in 0.400s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:52:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae6e4fe2-4f4e-45af-b91c-1f984af23f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9469289f-bdce-49ba-b89a-b23208581ecd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9777eb-8dc6-4325-9c8f-094e2c42d536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:45 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Volume volume-9469289f-bdce-49ba-b89a-b23208581ecd (9469289f-bdce-49ba-b89a-b23208581ecd): created successfully Sep 07 13:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9777eb-8dc6-4325-9c8f-094e2c42d536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Flow 'volume_create_manager' (bf504e9b-520c-47af-b25a-81bec8732773) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cd6dbc9d-ba9e-463f-8386-20add909f511 tempest-VolumesTransfersTest-278773506 None] Created volume successfully. Sep 07 13:52:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Acquiring lock "cinder-9469289f-bdce-49ba-b89a-b23208581ecd-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Lock "cinder-9469289f-bdce-49ba-b89a-b23208581ecd-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Acquiring lock "cinder-quobyte-9469289f-bdce-49ba-b89a-b23208581ecd" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Lock "cinder-quobyte-9469289f-bdce-49ba-b89a-b23208581ecd" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[de5425b1-94c2-4982-8bc4-d282e8e6a5da]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9469289f-bdce-49ba-b89a-b23208581ecd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:46 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9469289f-bdce-49ba-b89a-b23208581ecd Sep 07 13:52:46 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:47 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9469289f-bdce-49ba-b89a-b23208581ecd" returned: 0 in 0.752s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9469289f-bdce-49ba-b89a-b23208581ecd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:47 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9469289f-bdce-49ba-b89a-b23208581ecd Sep 07 13:52:47 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:47 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9469289f-bdce-49ba-b89a-b23208581ecd" returned: 0 in 0.462s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Lock "cinder-quobyte-9469289f-bdce-49ba-b89a-b23208581ecd" released by "delete_volume" :: held 1.273s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:48 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Created reservations ['69d06d1c-8261-43d9-bbe8-5f4ed6ad693f', '62de098a-d7e1-4e13-8147-cbbba226df2f', '6d3c8e13-417c-446f-acbb-03b5a4abf04e', '6079aa4e-c204-4ad7-895f-7d4da6244986'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:48 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:52:48 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:48 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.405s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:48 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:48 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Deleted volume successfully. Sep 07 13:52:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d8247119-be5d-48ca-90df-4442589deaf0 tempest-VolumesTransfersTest-602771613 None] Lock "cinder-9469289f-bdce-49ba-b89a-b23208581ecd-delete_volume" released by "delete_volume" :: held 2.147s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Flow 'volume_create_manager' (54059695-3058-4da4-9dd6-c8465ae4e76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632dc2e7-35f3-4657-a206-6779c0f9484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (632dc2e7-35f3-4657-a206-6779c0f9484f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1179483266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dac2acc-5d92-439d-a109-9e98bf5c4eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f78e5fa0e3eb452e982753e85efe9925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:51Z,use_quota=True,user_id='a1ded341871c4c90afa6ca4f4cd28618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8368307-dba4-4ce4-8a22-e2f84a1a03ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8368307-dba4-4ce4-8a22-e2f84a1a03ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca11b52e-eaaf-4c40-bff0-3c36d590fa8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca11b52e-eaaf-4c40-bff0-3c36d590fa8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dac2acc-5d92-439d-a109-9e98bf5c4eb3', 'volume_name': 'volume-4dac2acc-5d92-439d-a109-9e98bf5c4eb3', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b835c45-5588-4f27-954f-b947863aeb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b835c45-5588-4f27-954f-b947863aeb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c297af-f359-44ec-89be-abadbc06347a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:51 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Volume 4dac2acc-5d92-439d-a109-9e98bf5c4eb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dac2acc-5d92-439d-a109-9e98bf5c4eb3', 'volume_size': 1} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1179483266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dac2acc-5d92-439d-a109-9e98bf5c4eb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f78e5fa0e3eb452e982753e85efe9925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:51Z,use_quota=True,user_id='a1ded341871c4c90afa6ca4f4cd28618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Creating volume 4dac2acc-5d92-439d-a109-9e98bf5c4eb3 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:51 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dac2acc-5d92-439d-a109-9e98bf5c4eb3 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:51 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dac2acc-5d92-439d-a109-9e98bf5c4eb3 1073741824 Sep 07 13:52:51 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:51 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dac2acc-5d92-439d-a109-9e98bf5c4eb3 1073741824" returned: 0 in 0.536s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dac2acc-5d92-439d-a109-9e98bf5c4eb3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:51 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dac2acc-5d92-439d-a109-9e98bf5c4eb3 Sep 07 13:52:51 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:52 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dac2acc-5d92-439d-a109-9e98bf5c4eb3" returned: 0 in 0.360s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:52:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c297af-f359-44ec-89be-abadbc06347a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dac2acc-5d92-439d-a109-9e98bf5c4eb3', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9211fa0-c5de-4b41-bcb8-ca0be11d368b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:52 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Volume volume-4dac2acc-5d92-439d-a109-9e98bf5c4eb3 (4dac2acc-5d92-439d-a109-9e98bf5c4eb3): created successfully Sep 07 13:52:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9211fa0-c5de-4b41-bcb8-ca0be11d368b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Flow 'volume_create_manager' (54059695-3058-4da4-9dd6-c8465ae4e76c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0cb53b5a-af9f-4081-9b8b-7290be5b982d tempest-VolumesTransfersV357Test-63495819 None] Created volume successfully. Sep 07 13:52:54 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=107,cinder:UPDATE=150,cinder:DELETE=13,cinder:INSERT=31 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:52:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-378f1f22-4bb6-463f-8770-9f209cd8cbf7 tempest-VolumesTransfersV357Test-1199960727 None] Transfer volume completed successfully. Sep 07 13:52:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Acquiring lock "cinder-4dac2acc-5d92-439d-a109-9e98bf5c4eb3-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Lock "cinder-4dac2acc-5d92-439d-a109-9e98bf5c4eb3-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:55 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=106,cinder:UPDATE=137,cinder:INSERT=36,cinder:DELETE=11 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:52:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Acquiring lock "cinder-quobyte-4dac2acc-5d92-439d-a109-9e98bf5c4eb3" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:52:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Lock "cinder-quobyte-4dac2acc-5d92-439d-a109-9e98bf5c4eb3" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:52:55 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6160c5a-d1c5-44ec-9a28-09a16f8b1aa2]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:52:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dac2acc-5d92-439d-a109-9e98bf5c4eb3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:55 devstack sudo[98108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dac2acc-5d92-439d-a109-9e98bf5c4eb3 Sep 07 13:52:55 devstack sudo[98108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:56 devstack sudo[98108]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dac2acc-5d92-439d-a109-9e98bf5c4eb3" returned: 0 in 0.574s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dac2acc-5d92-439d-a109-9e98bf5c4eb3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:56 devstack sudo[98113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dac2acc-5d92-439d-a109-9e98bf5c4eb3 Sep 07 13:52:56 devstack sudo[98113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:56 devstack sudo[98113]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dac2acc-5d92-439d-a109-9e98bf5c4eb3" returned: 0 in 0.312s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Lock "cinder-quobyte-4dac2acc-5d92-439d-a109-9e98bf5c4eb3" released by "delete_volume" :: held 0.947s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:56 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Created reservations ['602c94a5-8791-4f18-9229-87a73f9442ce', 'cf807208-47ce-432a-bad3-b97a4a9dbc46', 'da5b904e-e11c-4846-912c-f5152f497e36', '548c44af-c309-46ef-9b4b-5c1b1dd91f73'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:52:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:56 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:52:56 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:56 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.374s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:56 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:52:56 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Deleted volume successfully. Sep 07 13:52:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-85740b30-3984-401f-8c25-82e1bfad427f tempest-VolumesTransfersV357Test-1161264205 None] Lock "cinder-4dac2acc-5d92-439d-a109-9e98bf5c4eb3-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Flow 'volume_create_manager' (e619caf5-c048-42be-9b9c-4c64f14352a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10cd3a16-7024-499c-b072-345067db1239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10cd3a16-7024-499c-b072-345067db1239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1002860440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d05af52-2203-4bf8-bdce-5f126df7a3a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f78e5fa0e3eb452e982753e85efe9925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:58Z,use_quota=True,user_id='a1ded341871c4c90afa6ca4f4cd28618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adffea00-1e47-4f9b-9e44-95b58186b7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adffea00-1e47-4f9b-9e44-95b58186b7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd63e2db-8809-4e8a-8f5d-10295e78f607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd63e2db-8809-4e8a-8f5d-10295e78f607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d05af52-2203-4bf8-bdce-5f126df7a3a8', 'volume_name': 'volume-1d05af52-2203-4bf8-bdce-5f126df7a3a8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5006150-9763-442e-b93c-26100dfac635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5006150-9763-442e-b93c-26100dfac635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e5bbb0-7401-4913-870e-b7421afb1d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:58 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Volume 1d05af52-2203-4bf8-bdce-5f126df7a3a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d05af52-2203-4bf8-bdce-5f126df7a3a8', 'volume_size': 1} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1002860440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d05af52-2203-4bf8-bdce-5f126df7a3a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f78e5fa0e3eb452e982753e85efe9925',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:58Z,use_quota=True,user_id='a1ded341871c4c90afa6ca4f4cd28618',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Creating volume 1d05af52-2203-4bf8-bdce-5f126df7a3a8 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:58 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:52:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1d05af52-2203-4bf8-bdce-5f126df7a3a8 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:58 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1d05af52-2203-4bf8-bdce-5f126df7a3a8 1073741824 Sep 07 13:52:58 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Flow 'volume_create_manager' (ea3da795-f81b-435f-ad03-9903e0b9b206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2276397e-cc19-4c35-a397-8178a0f8bf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2276397e-cc19-4c35-a397-8178a0f8bf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1615863179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92264c31-4641-4bcd-aec8-ee611fcb921d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234a21e383eb4fa5996236cf39411038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:59Z,use_quota=True,user_id='09579cb1f806428ca364ec53989f047b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ec5f27-7f35-4ef5-8481-5df1cbcc6283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:59 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9ec5f27-7f35-4ef5-8481-5df1cbcc6283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc066fe9-48c0-41b5-9dbf-cb2c39a041f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc066fe9-48c0-41b5-9dbf-cb2c39a041f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92264c31-4641-4bcd-aec8-ee611fcb921d', 'volume_name': 'volume-92264c31-4641-4bcd-aec8-ee611fcb921d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77689dd6-54b4-48d5-a774-39a4839c44d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77689dd6-54b4-48d5-a774-39a4839c44d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6747cd-2bcf-401b-90d4-f6bfa0faf057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:59 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Volume 92264c31-4641-4bcd-aec8-ee611fcb921d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92264c31-4641-4bcd-aec8-ee611fcb921d', 'volume_size': 1} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1d05af52-2203-4bf8-bdce-5f126df7a3a8 1073741824" returned: 0 in 0.646s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1d05af52-2203-4bf8-bdce-5f126df7a3a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:59 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1d05af52-2203-4bf8-bdce-5f126df7a3a8 Sep 07 13:52:59 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:59 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1d05af52-2203-4bf8-bdce-5f126df7a3a8" returned: 0 in 0.320s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.361s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:52:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1615863179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92264c31-4641-4bcd-aec8-ee611fcb921d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234a21e383eb4fa5996236cf39411038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:52:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:52:59Z,use_quota=True,user_id='09579cb1f806428ca364ec53989f047b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Creating volume 92264c31-4641-4bcd-aec8-ee611fcb921d {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:52:59 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-92264c31-4641-4bcd-aec8-ee611fcb921d 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:52:59 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-92264c31-4641-4bcd-aec8-ee611fcb921d 1073741824 Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67e5bbb0-7401-4913-870e-b7421afb1d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d05af52-2203-4bf8-bdce-5f126df7a3a8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:59 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3941dbbc-87e3-425b-aca0-2a75e5d6a5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:52:59 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Volume volume-1d05af52-2203-4bf8-bdce-5f126df7a3a8 (1d05af52-2203-4bf8-bdce-5f126df7a3a8): created successfully Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3941dbbc-87e3-425b-aca0-2a75e5d6a5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:52:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Flow 'volume_create_manager' (e619caf5-c048-42be-9b9c-4c64f14352a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:52:59 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-16bf9278-28fc-4248-a78a-86ccb1dd805f tempest-VolumesTransfersV357Test-63495819 None] Created volume successfully. Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Flow 'volume_create_manager' (06d7e314-6c86-400a-8a35-57eb91ee7980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44325f9a-8c17-4379-a3dc-e6ed7dcd1cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44325f9a-8c17-4379-a3dc-e6ed7dcd1cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1099317013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb7957b-5d91-4ff4-94f1-1fab45728a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60609b23b00849b7862a67f30b73b7de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:53:00Z,use_quota=True,user_id='289685d77d9f40e6908c9888b8db38f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b9ed09-0e19-4394-991f-777ae514eaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:00 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17b9ed09-0e19-4394-991f-777ae514eaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a8e08b-c712-4162-88b7-d3b8bf220d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a8e08b-c712-4162-88b7-d3b8bf220d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bb7957b-5d91-4ff4-94f1-1fab45728a0c', 'volume_name': 'volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65bb51ee-cc86-4a0e-a2a3-3dbe8a4b833e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65bb51ee-cc86-4a0e-a2a3-3dbe8a4b833e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960a45b9-98d0-4d79-b378-8fafdcc7b057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:00 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Volume 5bb7957b-5d91-4ff4-94f1-1fab45728a0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c', 'volume_size': 1} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-92264c31-4641-4bcd-aec8-ee611fcb921d 1073741824" returned: 0 in 0.606s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-92264c31-4641-4bcd-aec8-ee611fcb921d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:00 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-92264c31-4641-4bcd-aec8-ee611fcb921d Sep 07 13:53:00 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:00 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-92264c31-4641-4bcd-aec8-ee611fcb921d" returned: 0 in 0.334s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.376s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1099317013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bb7957b-5d91-4ff4-94f1-1fab45728a0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60609b23b00849b7862a67f30b73b7de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:53:00Z,use_quota=True,user_id='289685d77d9f40e6908c9888b8db38f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Creating volume 5bb7957b-5d91-4ff4-94f1-1fab45728a0c {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:53:00 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:00 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c 1073741824 Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab6747cd-2bcf-401b-90d4-f6bfa0faf057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92264c31-4641-4bcd-aec8-ee611fcb921d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:00 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f99f15-b25b-4bbb-aab0-82880b9e4502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:00 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Volume volume-92264c31-4641-4bcd-aec8-ee611fcb921d (92264c31-4641-4bcd-aec8-ee611fcb921d): created successfully Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97f99f15-b25b-4bbb-aab0-82880b9e4502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Flow 'volume_create_manager' (ea3da795-f81b-435f-ad03-9903e0b9b206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:00 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-36c89907-e5bc-406b-9cae-bbbeb85d4bfd tempest-VolumesTransfersV355Test-1738347477 None] Created volume successfully. Sep 07 13:53:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Acquiring lock "cinder-1d05af52-2203-4bf8-bdce-5f126df7a3a8-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Lock "cinder-1d05af52-2203-4bf8-bdce-5f126df7a3a8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Acquiring lock "cinder-quobyte-1d05af52-2203-4bf8-bdce-5f126df7a3a8" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:01 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Lock "cinder-quobyte-1d05af52-2203-4bf8-bdce-5f126df7a3a8" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c 1073741824" returned: 0 in 0.581s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[14816dbd-0dd1-4ddf-ab78-0c218ceabd47]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1d05af52-2203-4bf8-bdce-5f126df7a3a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:01 devstack sudo[98152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c Sep 07 13:53:01 devstack sudo[98152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:01 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1d05af52-2203-4bf8-bdce-5f126df7a3a8 Sep 07 13:53:01 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:01 devstack sudo[98152]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c" returned: 0 in 0.305s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (960a45b9-98d0-4d79-b378-8fafdcc7b057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f2c0c2-ffd8-43e7-8c58-d5aeeef2c22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:01 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Volume volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c (5bb7957b-5d91-4ff4-94f1-1fab45728a0c): created successfully Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61f2c0c2-ffd8-43e7-8c58-d5aeeef2c22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Flow 'volume_create_manager' (06d7e314-6c86-400a-8a35-57eb91ee7980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:01 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1d05af52-2203-4bf8-bdce-5f126df7a3a8" returned: 0 in 0.417s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1d05af52-2203-4bf8-bdce-5f126df7a3a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:01 devstack sudo[98159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1d05af52-2203-4bf8-bdce-5f126df7a3a8 Sep 07 13:53:01 devstack sudo[98159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-eb1fd5ba-c07b-4c66-b1e7-d08e3f212854 tempest-AttachVolumeNegativeTest-257270736 None] Created volume successfully. Sep 07 13:53:01 devstack sudo[98159]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1d05af52-2203-4bf8-bdce-5f126df7a3a8" returned: 0 in 0.421s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Lock "cinder-quobyte-1d05af52-2203-4bf8-bdce-5f126df7a3a8" released by "delete_volume" :: held 0.911s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:02 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Created reservations ['1496b7c4-b165-447d-b895-ab9519dc4340', 'e66a9d87-6487-46df-b852-780215739671', 'a5eb11ed-54be-4720-bc97-341857a48db2', '3ab3f49c-9560-4a90-9a58-f53b3ea12b12'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:53:02 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2fb7eb6b-6283-4697-9e18-e049d2797b2b tempest-VolumesTransfersV355Test-1050011139 None] Transfer volume completed successfully. Sep 07 13:53:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:02 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:53:02 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:02 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.342s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:02 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:53:02 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Deleted volume successfully. Sep 07 13:53:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-15822af4-d27c-4ae2-a55e-5b094ae070e3 tempest-VolumesTransfersV357Test-1161264205 None] Lock "cinder-1d05af52-2203-4bf8-bdce-5f126df7a3a8-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Acquiring lock "cinder-92264c31-4641-4bcd-aec8-ee611fcb921d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Lock "cinder-92264c31-4641-4bcd-aec8-ee611fcb921d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Acquiring lock "cinder-quobyte-92264c31-4641-4bcd-aec8-ee611fcb921d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Lock "cinder-quobyte-92264c31-4641-4bcd-aec8-ee611fcb921d" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:03 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[254356cc-c03a-4f7a-8f26-8f64b3f0ec3f]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-92264c31-4641-4bcd-aec8-ee611fcb921d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-87f87511-e5c5-4ee2-852c-73d06d837999 req-c60fa531-f70f-44de-8525-561cc8704ad2 tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-87f87511-e5c5-4ee2-852c-73d06d837999 req-c60fa531-f70f-44de-8525-561cc8704ad2 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-87f87511-e5c5-4ee2-852c-73d06d837999 req-c60fa531-f70f-44de-8525-561cc8704ad2 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-87f87511-e5c5-4ee2-852c-73d06d837999 req-c60fa531-f70f-44de-8525-561cc8704ad2 tempest-AttachVolumeNegativeTest-257270736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '45b5394d-1001-41c2-8b5a-fc175d81e4bb', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:53:03 devstack sudo[98177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-92264c31-4641-4bcd-aec8-ee611fcb921d Sep 07 13:53:03 devstack sudo[98177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:03 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-87f87511-e5c5-4ee2-852c-73d06d837999 req-c60fa531-f70f-44de-8525-561cc8704ad2 tempest-AttachVolumeNegativeTest-257270736 None] attachment_update completed successfully. Sep 07 13:53:03 devstack sudo[98177]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-92264c31-4641-4bcd-aec8-ee611fcb921d" returned: 0 in 0.774s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-92264c31-4641-4bcd-aec8-ee611fcb921d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:04 devstack sudo[98563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-92264c31-4641-4bcd-aec8-ee611fcb921d Sep 07 13:53:04 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:04 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-92264c31-4641-4bcd-aec8-ee611fcb921d" returned: 0 in 0.339s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Lock "cinder-quobyte-92264c31-4641-4bcd-aec8-ee611fcb921d" released by "delete_volume" :: held 1.173s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:04 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Created reservations ['78483fab-e431-441a-a6ed-db6b75d12d4e', 'f5e3a4d4-0a75-437e-986a-aaa84af67105', 'ea3c6333-4dd0-447d-b7bb-f15f0fdc9f89', 'c41673a5-6daa-42e8-9184-888f8fed24e0'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:53:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:04 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:53:04 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:04 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.304s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:04 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:53:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Deleted volume successfully. Sep 07 13:53:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8d3ff38-a583-4183-b14c-7a39169687c4 tempest-VolumesTransfersV355Test-548672986 None] Lock "cinder-92264c31-4641-4bcd-aec8-ee611fcb921d-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Flow 'volume_create_manager' (7d38f57e-208e-42b3-be9e-d64992fb8160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363a9e93-378c-4446-81d6-8a3399dca6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (363a9e93-378c-4446-81d6-8a3399dca6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1714018270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82070d9-4619-4432-822e-c1e824a29415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234a21e383eb4fa5996236cf39411038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:53:06Z,use_quota=True,user_id='09579cb1f806428ca364ec53989f047b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498a49fa-a505-4368-aa17-eab9597014e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (498a49fa-a505-4368-aa17-eab9597014e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c351078-2e7a-40d9-b23d-680e36b25993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c351078-2e7a-40d9-b23d-680e36b25993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a82070d9-4619-4432-822e-c1e824a29415', 'volume_name': 'volume-a82070d9-4619-4432-822e-c1e824a29415', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52edc730-f161-4ba1-acc3-40fdde06d8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52edc730-f161-4ba1-acc3-40fdde06d8e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad0e177-ac57-4249-a74e-c3dfbfed8d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:06 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Volume a82070d9-4619-4432-822e-c1e824a29415: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a82070d9-4619-4432-822e-c1e824a29415', 'volume_size': 1} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1714018270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a82070d9-4619-4432-822e-c1e824a29415,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='234a21e383eb4fa5996236cf39411038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:53:06Z,use_quota=True,user_id='09579cb1f806428ca364ec53989f047b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Creating volume a82070d9-4619-4432-822e-c1e824a29415 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:53:06 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a82070d9-4619-4432-822e-c1e824a29415 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:06 devstack sudo[98570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a82070d9-4619-4432-822e-c1e824a29415 1073741824 Sep 07 13:53:06 devstack sudo[98570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-5dd30444-7a7d-4e5f-8e50-f51ca9f7a0cb req-b5ca566d-9991-4a90-ab80-e58efb279697 tempest-AttachVolumeNegativeTest-257270736 None] Terminate volume connection completed successfully. Sep 07 13:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-5dd30444-7a7d-4e5f-8e50-f51ca9f7a0cb req-b5ca566d-9991-4a90-ab80-e58efb279697 tempest-AttachVolumeNegativeTest-257270736 None] Deleting attachment 45b5394d-1001-41c2-8b5a-fc175d81e4bb. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:53:07 devstack sudo[98570]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a82070d9-4619-4432-822e-c1e824a29415 1073741824" returned: 0 in 0.751s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a82070d9-4619-4432-822e-c1e824a29415 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:07 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a82070d9-4619-4432-822e-c1e824a29415 Sep 07 13:53:07 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:07 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a82070d9-4619-4432-822e-c1e824a29415" returned: 0 in 0.382s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:53:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ad0e177-ac57-4249-a74e-c3dfbfed8d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a82070d9-4619-4432-822e-c1e824a29415', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7a98b7-88d4-4a69-82da-09b8765c23dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:07 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Volume volume-a82070d9-4619-4432-822e-c1e824a29415 (a82070d9-4619-4432-822e-c1e824a29415): created successfully Sep 07 13:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7a98b7-88d4-4a69-82da-09b8765c23dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Flow 'volume_create_manager' (7d38f57e-208e-42b3-be9e-d64992fb8160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-901f2428-14fa-4850-9f96-2541511ebb2a tempest-VolumesTransfersV355Test-1738347477 None] Created volume successfully. Sep 07 13:53:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Acquiring lock "cinder-a82070d9-4619-4432-822e-c1e824a29415-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Lock "cinder-a82070d9-4619-4432-822e-c1e824a29415-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Acquiring lock "cinder-quobyte-a82070d9-4619-4432-822e-c1e824a29415" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Lock "cinder-quobyte-a82070d9-4619-4432-822e-c1e824a29415" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3dd7d3-ecf5-4853-93f8-266eb5d2e084]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a82070d9-4619-4432-822e-c1e824a29415 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:09 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a82070d9-4619-4432-822e-c1e824a29415 Sep 07 13:53:09 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:09 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a82070d9-4619-4432-822e-c1e824a29415" returned: 0 in 0.626s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a82070d9-4619-4432-822e-c1e824a29415 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:09 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a82070d9-4619-4432-822e-c1e824a29415 Sep 07 13:53:09 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:10 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a82070d9-4619-4432-822e-c1e824a29415" returned: 0 in 0.407s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Lock "cinder-quobyte-a82070d9-4619-4432-822e-c1e824a29415" released by "delete_volume" :: held 1.109s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:10 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Created reservations ['6266b490-5b60-4093-8bb7-339ef42eef24', 'd149781f-47a5-4775-8de2-ee09a21de66c', '16916a6f-37d8-42a2-85df-fb1a7c0fba65', '33fe7fa3-6a53-4e90-b7eb-fcb755a5910e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:53:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:10 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:53:10 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:10 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.283s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:10 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:53:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Deleted volume successfully. Sep 07 13:53:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-623d6674-60a1-4314-9a33-351756fe85d7 tempest-VolumesTransfersV355Test-548672986 None] Lock "cinder-a82070d9-4619-4432-822e-c1e824a29415-delete_volume" released by "delete_volume" :: held 1.687s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:20 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=38,cinder:INSERT=9,cinder:UPDATE=51,cinder:DELETE=4 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:53:20 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=34,cinder:INSERT=11,cinder:UPDATE=39,cinder:DELETE=4 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:53:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:53:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:29 devstack sudo[98686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:53:29 devstack sudo[98686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:30 devstack sudo[98686]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.544s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 29 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Flow 'volume_create_manager' (ea948e78-f51d-418d-8594-eb4287b87445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ad1f29-32dd-49bc-be05-3680dc81c32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34ad1f29-32dd-49bc-be05-3680dc81c32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-417228236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e419c9-f5d1-4a1a-99a8-3a5a67611c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58f60ffbdcd4e6eadea3282d544ccee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:53:30Z,use_quota=True,user_id='1212bc2c22c647569fb48e2c6731f12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb8e4f0-9eda-4426-984e-298c8c4e695a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9eb8e4f0-9eda-4426-984e-298c8c4e695a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de66eafc-b98c-42d0-8b34-320566d3f35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de66eafc-b98c-42d0-8b34-320566d3f35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51e419c9-f5d1-4a1a-99a8-3a5a67611c60', 'volume_name': 'volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af6bf2a-9a64-4cf3-81eb-a47ff8045c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7af6bf2a-9a64-4cf3-81eb-a47ff8045c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950733cc-1bf3-4c03-8c26-c523c47d087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:30 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Volume 51e419c9-f5d1-4a1a-99a8-3a5a67611c60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60', 'volume_size': 1} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:53:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-417228236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51e419c9-f5d1-4a1a-99a8-3a5a67611c60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b58f60ffbdcd4e6eadea3282d544ccee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:53:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:53:30Z,use_quota=True,user_id='1212bc2c22c647569fb48e2c6731f12d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Creating volume 51e419c9-f5d1-4a1a-99a8-3a5a67611c60 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:53:30 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:30 devstack sudo[98689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 1073741824 Sep 07 13:53:30 devstack sudo[98689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:31 devstack sudo[98689]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 1073741824" returned: 0 in 0.553s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:31 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 Sep 07 13:53:31 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:31 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" returned: 0 in 0.310s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:53:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (950733cc-1bf3-4c03-8c26-c523c47d087b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779ddae5-2ce1-432e-a1dd-ade5a4b40ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:31 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Volume volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 (51e419c9-f5d1-4a1a-99a8-3a5a67611c60): created successfully Sep 07 13:53:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779ddae5-2ce1-432e-a1dd-ade5a4b40ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Flow 'volume_create_manager' (ea948e78-f51d-418d-8594-eb4287b87445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-009d5c3b-cb95-4c56-b419-58c8a51c3562 tempest-VolumesActionsTest-1046164172 None] Created volume successfully. Sep 07 13:53:41 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:53:41 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Flow 'volume_create_manager' (86625a8f-c996-45db-996d-831c6ce8aacb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc93803f-a68e-4f37-9638-b7d179e30de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc93803f-a68e-4f37-9638-b7d179e30de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1235754812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22121ac4-9321-4341-9340-2d96fbd86607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11b21df7e094855b91b5954d4a6abc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:53:43Z,use_quota=True,user_id='3c263f9a6d354c24b9f5e90ce316fd64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4ba680-a16c-4eaf-b5e3-e3ec0e2d9ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c4ba680-a16c-4eaf-b5e3-e3ec0e2d9ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51490652-e4e4-451c-bba0-7a130b63cfc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51490652-e4e4-451c-bba0-7a130b63cfc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22121ac4-9321-4341-9340-2d96fbd86607', 'volume_name': 'volume-22121ac4-9321-4341-9340-2d96fbd86607', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f17a53-dc78-4009-aa01-5ec26e97f075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f17a53-dc78-4009-aa01-5ec26e97f075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50012514-dc47-4924-9541-e7a9d76f4056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:43 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Volume 22121ac4-9321-4341-9340-2d96fbd86607: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22121ac4-9321-4341-9340-2d96fbd86607', 'volume_size': 1} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:53:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1235754812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22121ac4-9321-4341-9340-2d96fbd86607,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11b21df7e094855b91b5954d4a6abc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:53:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:53:43Z,use_quota=True,user_id='3c263f9a6d354c24b9f5e90ce316fd64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Creating volume 22121ac4-9321-4341-9340-2d96fbd86607 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:53:43 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:53:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:43 devstack sudo[98889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607 1073741824 Sep 07 13:53:43 devstack sudo[98889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:44 devstack sudo[98889]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607 1073741824" returned: 0 in 0.773s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:44 devstack sudo[98895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607 Sep 07 13:53:44 devstack sudo[98895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:44 devstack sudo[98895]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607" returned: 0 in 0.561s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:53:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.418s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50012514-dc47-4924-9541-e7a9d76f4056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22121ac4-9321-4341-9340-2d96fbd86607', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224dda26-2281-4604-ba73-19957eec6b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Volume volume-22121ac4-9321-4341-9340-2d96fbd86607 (22121ac4-9321-4341-9340-2d96fbd86607): created successfully Sep 07 13:53:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (224dda26-2281-4604-ba73-19957eec6b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Flow 'volume_create_manager' (86625a8f-c996-45db-996d-831c6ce8aacb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fc1526f4-62b0-41fa-b31d-01aecc467a5a tempest-VolumesSnapshotTestJSON-292525226 None] Created volume successfully. Sep 07 13:53:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] Creating offline snapshot d92291b2-a2b0-40a9-899a-089c087a6409 of volume 22121ac4-9321-4341-9340-2d96fbd86607 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:53:45 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6886d760-6716-42cc-82e1-b534e3f02014]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:46 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607 Sep 07 13:53:46 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:46 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607" returned: 0 in 0.804s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:46 devstack sudo[98905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409 1G Sep 07 13:53:46 devstack sudo[98905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:47 devstack sudo[98905]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409 1G" returned: 0 in 0.726s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22121ac4-9321-4341-9340-2d96fbd86607 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:47 devstack sudo[98911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22121ac4-9321-4341-9340-2d96fbd86607 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409 Sep 07 13:53:47 devstack sudo[98911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:48 devstack sudo[98911]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22121ac4-9321-4341-9340-2d96fbd86607 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409" returned: 0 in 0.637s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:48 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409 is being set with open permissions: ugo+rw Sep 07 13:53:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:48 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409 Sep 07 13:53:48 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:48 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409" returned: 0 in 0.426s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:48 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.info Sep 07 13:53:48 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:49 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.info" returned: 0 in 0.735s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:49 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.info is being set with open permissions: ugo+rw Sep 07 13:53:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:49 devstack sudo[98949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.info Sep 07 13:53:49 devstack sudo[98949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:50 devstack sudo[98949]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.info" returned: 0 in 0.967s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.492s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-71a7df01-409b-41d8-a865-94c6c0a4517b tempest-VolumesSnapshotTestJSON-292525226 None] Create snapshot completed successfully Sep 07 13:53:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-d92291b2-a2b0-40a9-899a-089c087a6409-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-d92291b2-a2b0-40a9-899a-089c087a6409-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-quobyte-22121ac4-9321-4341-9340-2d96fbd86607" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-22121ac4-9321-4341-9340-2d96fbd86607" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-quobyte-d92291b2-a2b0-40a9-899a-089c087a6409" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-d92291b2-a2b0-40a9-899a-089c087a6409" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Deleting offline snapshot d92291b2-a2b0-40a9-899a-089c087a6409 of volume 22121ac4-9321-4341-9340-2d96fbd86607 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:53:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] snapshot_file for this snap is: volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:53:52 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fe0ec2-7285-44ab-8f62-67e982c576da]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:52 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409 Sep 07 13:53:52 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:52 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409" returned: 0 in 0.538s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22121ac4-9321-4341-9340-2d96fbd86607(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:53:52 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[48434d2c-0ba6-4f58-acf1-69496978d5d6]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:52 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607 Sep 07 13:53:52 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:52 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607" returned: 0 in 0.387s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:52 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409 Sep 07 13:53:52 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:53 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409" returned: 0 in 0.402s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:53 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409 Sep 07 13:53:53 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c178e196-ac84-4c60-a5e8-f884e216d123 tempest-VolumesActionsTest-1046164172 None] Acquiring lock "cinder-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" by "attach_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c178e196-ac84-4c60-a5e8-f884e216d123 tempest-VolumesActionsTest-1046164172 None] Lock "cinder-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" acquired by "attach_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c178e196-ac84-4c60-a5e8-f884e216d123 tempest-VolumesActionsTest-1046164172 None] Attaching volume 51e419c9-f5d1-4a1a-99a8-3a5a67611c60 to instance adaace62-bc2e-4f1e-8c6d-de33d0548821 at mountpoint /dev/vdb on host None. Sep 07 13:53:53 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607.d92291b2-a2b0-40a9-899a-089c087a6409" returned: 0 in 0.282s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c178e196-ac84-4c60-a5e8-f884e216d123 tempest-VolumesActionsTest-1046164172 None] Attach volume completed successfully. Sep 07 13:53:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c178e196-ac84-4c60-a5e8-f884e216d123 tempest-VolumesActionsTest-1046164172 None] Lock "cinder-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" released by "attach_volume" :: held 0.148s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-d92291b2-a2b0-40a9-899a-089c087a6409" released by "_delete_snapshot" :: held 1.796s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-22121ac4-9321-4341-9340-2d96fbd86607" released by "delete_snapshot" :: held 1.846s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:53 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Created reservations ['b7d67b82-622d-424b-bce3-f1d20cee8e56', '9981e4fc-d3fe-417c-9bf8-975de94f8e39', 'af959f5a-f1fb-406f-afa2-b070db04b46a', '995adf0a-b26a-4ce6-84fb-f7f69b358ab1'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:53:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-93d22f4e-e6d7-4f99-ab99-6a89914783c7 tempest-VolumesActionsTest-1046164172 None] Acquiring lock "cinder-51e419c9-f5d1-4a1a-99a8-3a5a67611c60-detach_volume" by "detach_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:53:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Delete snapshot completed successfully. Sep 07 13:53:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df355601-5133-4106-ae88-b3a6cf06562a tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-d92291b2-a2b0-40a9-899a-089c087a6409-delete_snapshot" released by "delete_snapshot" :: held 2.139s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-93d22f4e-e6d7-4f99-ab99-6a89914783c7 tempest-VolumesActionsTest-1046164172 None] Lock "cinder-51e419c9-f5d1-4a1a-99a8-3a5a67611c60-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:53:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-93d22f4e-e6d7-4f99-ab99-6a89914783c7 tempest-VolumesActionsTest-1046164172 None] Detaching volume 51e419c9-f5d1-4a1a-99a8-3a5a67611c60 from instance adaace62-bc2e-4f1e-8c6d-de33d0548821. Sep 07 13:53:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-93d22f4e-e6d7-4f99-ab99-6a89914783c7 tempest-VolumesActionsTest-1046164172 None] Detach volume completed successfully. Sep 07 13:53:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-93d22f4e-e6d7-4f99-ab99-6a89914783c7 tempest-VolumesActionsTest-1046164172 None] Lock "cinder-51e419c9-f5d1-4a1a-99a8-3a5a67611c60-detach_volume" released by "detach_volume" :: held 0.086s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Flow 'volume_create_manager' (e47f78eb-6ba1-47ed-b052-145b243af24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f0fdcc-c366-4a5c-b5e5-e48119a39605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2f0fdcc-c366-4a5c-b5e5-e48119a39605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1140598616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ad1cc27-e32e-488b-a027-3daf0901235e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11b21df7e094855b91b5954d4a6abc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:53:56Z,use_quota=True,user_id='3c263f9a6d354c24b9f5e90ce316fd64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ca0053-c842-4aaa-8faa-5d75adf662f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7ca0053-c842-4aaa-8faa-5d75adf662f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34dfa532-6fe7-48fc-b346-f554dadf58e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34dfa532-6fe7-48fc-b346-f554dadf58e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ad1cc27-e32e-488b-a027-3daf0901235e', 'volume_name': 'volume-0ad1cc27-e32e-488b-a027-3daf0901235e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e340e6-92db-45a0-a714-e9d5a5fde4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8e340e6-92db-45a0-a714-e9d5a5fde4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31921939-85fd-4bbb-a398-5f6bd92be1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:55 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Volume 0ad1cc27-e32e-488b-a027-3daf0901235e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ad1cc27-e32e-488b-a027-3daf0901235e', 'volume_size': 1} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:53:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1140598616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ad1cc27-e32e-488b-a027-3daf0901235e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11b21df7e094855b91b5954d4a6abc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:53:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:53:56Z,use_quota=True,user_id='3c263f9a6d354c24b9f5e90ce316fd64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Creating volume 0ad1cc27-e32e-488b-a027-3daf0901235e {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:53:55 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:53:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:55 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e 1073741824 Sep 07 13:53:55 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:56 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e 1073741824" returned: 0 in 0.523s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:56 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e Sep 07 13:53:56 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:56 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e" returned: 0 in 0.250s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:53:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:53:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31921939-85fd-4bbb-a398-5f6bd92be1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ad1cc27-e32e-488b-a027-3daf0901235e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfda70e9-e9e3-4b48-88cd-6462410378ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:53:56 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Volume volume-0ad1cc27-e32e-488b-a027-3daf0901235e (0ad1cc27-e32e-488b-a027-3daf0901235e): created successfully Sep 07 13:53:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfda70e9-e9e3-4b48-88cd-6462410378ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:53:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Flow 'volume_create_manager' (e47f78eb-6ba1-47ed-b052-145b243af24b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:53:56 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-204070f9-a4f2-40c2-9ea6-9083af9b6908 tempest-VolumesSnapshotTestJSON-292525226 None] Created volume successfully. Sep 07 13:53:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:53:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:53:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] Creating offline snapshot 6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 of volume 0ad1cc27-e32e-488b-a027-3daf0901235e {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:53:57 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e12e3888-4166-4a90-bb34-a29bcbe61bbe]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:53:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:58 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e Sep 07 13:53:58 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:58 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e" returned: 0 in 0.411s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:58 devstack sudo[99120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 1G Sep 07 13:53:58 devstack sudo[99120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:58 devstack sudo[99120]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 1G" returned: 0 in 0.523s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ad1cc27-e32e-488b-a027-3daf0901235e -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:58 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ad1cc27-e32e-488b-a027-3daf0901235e -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 Sep 07 13:53:58 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:59 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ad1cc27-e32e-488b-a027-3daf0901235e -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18" returned: 0 in 0.393s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:59 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 is being set with open permissions: ugo+rw Sep 07 13:53:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:59 devstack sudo[99133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 Sep 07 13:53:59 devstack sudo[99133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:53:59 devstack sudo[99133]: pam_unix(sudo:session): session closed for user root Sep 07 13:53:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18" returned: 0 in 0.315s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:53:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:53:59 devstack sudo[99146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.info Sep 07 13:53:59 devstack sudo[99146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:00 devstack sudo[99146]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.info" returned: 0 in 0.575s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:00 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.info is being set with open permissions: ugo+rw Sep 07 13:54:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:00 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.info Sep 07 13:54:00 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:00 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.info" returned: 0 in 0.347s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.685s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:00 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a30d1d06-2ffb-4558-828d-d51176742894 tempest-VolumesSnapshotTestJSON-292525226 None] Create snapshot completed successfully Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Flow 'volume_create_manager' (d3fc323b-eaac-4553-b5e4-92dacce1cfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc13c368-994d-49a9-bc79-d25d7fb16070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc13c368-994d-49a9-bc79-d25d7fb16070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1304471475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69cbe85a-913d-4357-899d-8ec11327090f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11b21df7e094855b91b5954d4a6abc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:02Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:02Z,use_quota=True,user_id='3c263f9a6d354c24b9f5e90ce316fd64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4d247e-5790-4e70-b88b-bb74c09c8636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4d247e-5790-4e70-b88b-bb74c09c8636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910b9b6a-8064-4540-9120-e996b2c9e9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (910b9b6a-8064-4540-9120-e996b2c9e9c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '69cbe85a-913d-4357-899d-8ec11327090f', 'volume_name': 'volume-69cbe85a-913d-4357-899d-8ec11327090f', 'volume_size': 2, 'snapshot_id': '6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a64c208-7d5c-4e17-8fdc-2c8d90246245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a64c208-7d5c-4e17-8fdc-2c8d90246245) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c67e37ad-c05d-425d-9efc-9435e3bc956e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:02 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Volume 69cbe85a-913d-4357-899d-8ec11327090f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-69cbe85a-913d-4357-899d-8ec11327090f', 'volume_size': 2, 'snapshot_id': '6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18'} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-quobyte-6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18-69cbe85a-913d-4357-899d-8ec11327090f" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18-69cbe85a-913d-4357-899d-8ec11327090f" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Creating volume 69cbe85a-913d-4357-899d-8ec11327090f from snapshot 6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-quobyte-69cbe85a-913d-4357-899d-8ec11327090f" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-69cbe85a-913d-4357-899d-8ec11327090f" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] snapshot: 6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18, volume: 69cbe85a-913d-4357-899d-8ec11327090f, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2d68b4-e88a-4f4c-8dba-70d19742fc72]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:02 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 Sep 07 13:54:02 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:03 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18" returned: 0 in 1.094s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ad1cc27-e32e-488b-a027-3daf0901235e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:54:03 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[df23bde7-cff2-4965-aa9e-1ac26b4694b8]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:54:03 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e Sep 07 13:54:03 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Flow 'volume_create_manager' (f370f732-8ba3-46e7-81a1-7661ba1abb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d03321-c999-4238-b3a2-71d36b8294d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20d03321-c999-4238-b3a2-71d36b8294d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1657800740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6337d77-f714-4b7d-bcf9-db4b36bd5718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60609b23b00849b7862a67f30b73b7de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:04Z,use_quota=True,user_id='289685d77d9f40e6908c9888b8db38f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953a4498-a685-432a-9cac-a3259ad388cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (953a4498-a685-432a-9cac-a3259ad388cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11493e8b-1128-464a-8c6a-77a7265e339a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11493e8b-1128-464a-8c6a-77a7265e339a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6337d77-f714-4b7d-bcf9-db4b36bd5718', 'volume_name': 'volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0cc676a-3e5d-4265-b4e3-48320a7d4246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0cc676a-3e5d-4265-b4e3-48320a7d4246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c496059-2006-4f94-a772-6a755ab754f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:03 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Volume e6337d77-f714-4b7d-bcf9-db4b36bd5718: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718', 'volume_size': 1} Sep 07 13:54:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:04 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e" returned: 0 in 0.686s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] will copy from snapshot at /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:54:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:54:04 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Path /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-69cbe85a-913d-4357-899d-8ec11327090f not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:54:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-69cbe85a-913d-4357-899d-8ec11327090f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:04 devstack sudo[99242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-69cbe85a-913d-4357-899d-8ec11327090f Sep 07 13:54:04 devstack sudo[99242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-feee91a6-b570-4d86-936d-073d5a4e6f54 tempest-VolumesActionsTest-1046164172 None] Acquiring lock "cinder-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" by "attach_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-feee91a6-b570-4d86-936d-073d5a4e6f54 tempest-VolumesActionsTest-1046164172 None] Lock "cinder-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" acquired by "attach_volume" :: waited 0.059s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-feee91a6-b570-4d86-936d-073d5a4e6f54 tempest-VolumesActionsTest-1046164172 None] Attaching volume 51e419c9-f5d1-4a1a-99a8-3a5a67611c60 to instance 322904d4-2897-4f3f-95e9-f9d0299431a3 at mountpoint /dev/vdb on host None. Sep 07 13:54:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-feee91a6-b570-4d86-936d-073d5a4e6f54 tempest-VolumesActionsTest-1046164172 None] Attach volume completed successfully. Sep 07 13:54:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-feee91a6-b570-4d86-936d-073d5a4e6f54 tempest-VolumesActionsTest-1046164172 None] Lock "cinder-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" released by "attach_volume" :: held 0.425s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-25d9669e-1cae-4a44-b916-7508227965ae tempest-VolumesActionsTest-1046164172 None] Acquiring lock "cinder-51e419c9-f5d1-4a1a-99a8-3a5a67611c60-detach_volume" by "detach_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-25d9669e-1cae-4a44-b916-7508227965ae tempest-VolumesActionsTest-1046164172 None] Lock "cinder-51e419c9-f5d1-4a1a-99a8-3a5a67611c60-detach_volume" acquired by "detach_volume" :: waited 0.057s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-25d9669e-1cae-4a44-b916-7508227965ae tempest-VolumesActionsTest-1046164172 None] Detaching volume 51e419c9-f5d1-4a1a-99a8-3a5a67611c60 from instance 322904d4-2897-4f3f-95e9-f9d0299431a3. Sep 07 13:54:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-25d9669e-1cae-4a44-b916-7508227965ae tempest-VolumesActionsTest-1046164172 None] Detach volume completed successfully. Sep 07 13:54:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-25d9669e-1cae-4a44-b916-7508227965ae tempest-VolumesActionsTest-1046164172 None] Lock "cinder-51e419c9-f5d1-4a1a-99a8-3a5a67611c60-detach_volume" released by "detach_volume" :: held 0.263s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:10 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:54:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Flow 'volume_create_manager' (b9152616-56d5-4533-87f4-d9418e49403e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b8e8d6-9729-408e-ace1-6946b8722920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5b8e8d6-9729-408e-ace1-6946b8722920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1738438423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ffc771c-558f-401c-92e2-687fde8f50aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='071a967d94f34fa38d35124159910a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:10Z,use_quota=True,user_id='bc63f85daea747a8992fd2fbd6b46585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591b75da-537f-4159-8514-6f935c0f2aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591b75da-537f-4159-8514-6f935c0f2aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72c2469-4a8b-4517-bc08-89c6c13d430a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b72c2469-4a8b-4517-bc08-89c6c13d430a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ffc771c-558f-401c-92e2-687fde8f50aa', 'volume_name': 'volume-3ffc771c-558f-401c-92e2-687fde8f50aa', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d26b0f-5a28-4cdd-8520-d201957208a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7d26b0f-5a28-4cdd-8520-d201957208a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67fa5e60-aa44-47f8-b37a-fac340fe2720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:10 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Volume 3ffc771c-558f-401c-92e2-687fde8f50aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ffc771c-558f-401c-92e2-687fde8f50aa', 'volume_size': 1} Sep 07 13:54:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:11 devstack sudo[99242]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-69cbe85a-913d-4357-899d-8ec11327090f" returned: 0 in 7.777s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:11 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Image conversion details: src /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e, size 1024.00 MB, duration 7.78 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-69cbe85a-913d-4357-899d-8ec11327090f {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:54:11 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Converted 1024.00 MB image at 131.66 MB/s Sep 07 13:54:11 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-69cbe85a-913d-4357-899d-8ec11327090f is being set with open permissions: ugo+rw Sep 07 13:54:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-69cbe85a-913d-4357-899d-8ec11327090f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:11 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-69cbe85a-913d-4357-899d-8ec11327090f Sep 07 13:54:11 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:12 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-69cbe85a-913d-4357-899d-8ec11327090f" returned: 0 in 0.376s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-69cbe85a-913d-4357-899d-8ec11327090f" released by "_copy_volume_from_snapshot" :: held 10.070s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18-69cbe85a-913d-4357-899d-8ec11327090f" released by "_create_volume_from_snapshot" :: held 10.167s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.195s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.596s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1657800740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6337d77-f714-4b7d-bcf9-db4b36bd5718,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60609b23b00849b7862a67f30b73b7de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:04Z,use_quota=True,user_id='289685d77d9f40e6908c9888b8db38f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Creating volume e6337d77-f714-4b7d-bcf9-db4b36bd5718 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:54:12 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:12 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718 1073741824 Sep 07 13:54:12 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c67e37ad-c05d-425d-9efc-9435e3bc956e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69cbe85a-913d-4357-899d-8ec11327090f', 'volume_size': 2, 'snapshot_id': '6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85934ece-5cf6-4729-8e2a-b67e81286f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:12 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Volume volume-69cbe85a-913d-4357-899d-8ec11327090f (69cbe85a-913d-4357-899d-8ec11327090f): created successfully Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85934ece-5cf6-4729-8e2a-b67e81286f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Flow 'volume_create_manager' (d3fc323b-eaac-4553-b5e4-92dacce1cfd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ee442b85-08d9-422f-956d-8441b4925910 tempest-VolumesSnapshotTestJSON-292525226 None] Created volume successfully. Sep 07 13:54:13 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718 1073741824" returned: 0 in 0.668s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:13 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718 Sep 07 13:54:13 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:13 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-69cbe85a-913d-4357-899d-8ec11327090f-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718" returned: 0 in 0.316s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.049s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.562s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1738438423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ffc771c-558f-401c-92e2-687fde8f50aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='071a967d94f34fa38d35124159910a97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:10Z,use_quota=True,user_id='bc63f85daea747a8992fd2fbd6b46585',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Creating volume 3ffc771c-558f-401c-92e2-687fde8f50aa {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:54:13 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ffc771c-558f-401c-92e2-687fde8f50aa 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-69cbe85a-913d-4357-899d-8ec11327090f-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c496059-2006-4f94-a772-6a755ab754f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72cec21d-8c78-47b3-8f4a-528b243b1d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:13 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ffc771c-558f-401c-92e2-687fde8f50aa 1073741824 Sep 07 13:54:13 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:13 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Volume volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718 (e6337d77-f714-4b7d-bcf9-db4b36bd5718): created successfully Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72cec21d-8c78-47b3-8f4a-528b243b1d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Flow 'volume_create_manager' (f370f732-8ba3-46e7-81a1-7661ba1abb03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:13 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-57136563-2046-474c-bc65-c2f1b2bca644 tempest-AttachVolumeNegativeTest-257270736 None] Created volume successfully. Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-quobyte-69cbe85a-913d-4357-899d-8ec11327090f" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-69cbe85a-913d-4357-899d-8ec11327090f" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[721bc8ab-19eb-47a7-a88f-5e3bccefdbb2]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-69cbe85a-913d-4357-899d-8ec11327090f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:13 devstack sudo[99313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-69cbe85a-913d-4357-899d-8ec11327090f Sep 07 13:54:13 devstack sudo[99313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:13 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ffc771c-558f-401c-92e2-687fde8f50aa 1073741824" returned: 0 in 0.482s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ffc771c-558f-401c-92e2-687fde8f50aa {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:14 devstack sudo[99322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ffc771c-558f-401c-92e2-687fde8f50aa Sep 07 13:54:14 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:14 devstack sudo[99313]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-69cbe85a-913d-4357-899d-8ec11327090f" returned: 0 in 0.436s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-69cbe85a-913d-4357-899d-8ec11327090f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:14 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-69cbe85a-913d-4357-899d-8ec11327090f Sep 07 13:54:14 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:14 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ffc771c-558f-401c-92e2-687fde8f50aa" returned: 0 in 0.309s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67fa5e60-aa44-47f8-b37a-fac340fe2720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ffc771c-558f-401c-92e2-687fde8f50aa', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a7dfaa-787f-4662-b937-7f1881ef43d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:14 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-69cbe85a-913d-4357-899d-8ec11327090f" returned: 0 in 0.281s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:14 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Volume volume-3ffc771c-558f-401c-92e2-687fde8f50aa (3ffc771c-558f-401c-92e2-687fde8f50aa): created successfully Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84a7dfaa-787f-4662-b937-7f1881ef43d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Flow 'volume_create_manager' (b9152616-56d5-4533-87f4-d9418e49403e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-69cbe85a-913d-4357-899d-8ec11327090f" released by "delete_volume" :: held 0.782s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ea1e8f0a-7715-4afa-ae35-c715e1d58d5f tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Created volume successfully. Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Created reservations ['973109f2-b705-481b-9c0b-e637d66f9c66', 'f6cdf94f-e415-4cdf-9c71-62b3aa824d19', '69fad70e-1d17-49a3-8adb-6aed1658a131', '0ba75001-68b1-414a-96b5-d349bee256d7'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:14 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:54:14 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-quobyte-0ad1cc27-e32e-488b-a027-3daf0901235e" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-0ad1cc27-e32e-488b-a027-3daf0901235e" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-quobyte-6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Deleting offline snapshot 6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 of volume 0ad1cc27-e32e-488b-a027-3daf0901235e {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] snapshot_file for this snap is: volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be45aa6-c801-4a15-a22d-e43c4d889145]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:14 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.455s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:14 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:54:15 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Deleted volume successfully. Sep 07 13:54:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0d103031-126b-4595-b512-7743a5275d93 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-69cbe85a-913d-4357-899d-8ec11327090f-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:15 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 Sep 07 13:54:15 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:15 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18" returned: 0 in 0.632s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ad1cc27-e32e-488b-a027-3daf0901235e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:54:15 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[daede53f-fe44-46c9-9a29-1b7d7d46e308]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:15 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e Sep 07 13:54:15 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-c64e72d7-3423-4b11-8cec-1e62de784789 req-c26727bd-1bbe-42a4-a286-67d4680becb7 tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-c64e72d7-3423-4b11-8cec-1e62de784789 req-c26727bd-1bbe-42a4-a286-67d4680becb7 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-c64e72d7-3423-4b11-8cec-1e62de784789 req-c26727bd-1bbe-42a4-a286-67d4680becb7 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-c64e72d7-3423-4b11-8cec-1e62de784789 req-c26727bd-1bbe-42a4-a286-67d4680becb7 tempest-AttachVolumeNegativeTest-257270736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7de14027-2293-4c95-81e1-8ae3120f67c8', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:54:15 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-c64e72d7-3423-4b11-8cec-1e62de784789 req-c26727bd-1bbe-42a4-a286-67d4680becb7 tempest-AttachVolumeNegativeTest-257270736 None] attachment_update completed successfully. Sep 07 13:54:16 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e" returned: 0 in 0.813s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:16 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 Sep 07 13:54:16 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-4f5b25ac-bfec-422a-892e-33cb8c18ef22 req-443f92b7-75c4-45a4-b718-1b357a3fead4 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-4f5b25ac-bfec-422a-892e-33cb8c18ef22 req-443f92b7-75c4-45a4-b718-1b357a3fead4 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-4f5b25ac-bfec-422a-892e-33cb8c18ef22 req-443f92b7-75c4-45a4-b718-1b357a3fead4 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-4f5b25ac-bfec-422a-892e-33cb8c18ef22 req-443f92b7-75c4-45a4-b718-1b357a3fead4 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-3ffc771c-558f-401c-92e2-687fde8f50aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd8d18916-b214-462e-9b6d-bc8a68be29a8', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:54:16 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-4f5b25ac-bfec-422a-892e-33cb8c18ef22 req-443f92b7-75c4-45a4-b718-1b357a3fead4 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] attachment_update completed successfully. Sep 07 13:54:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-caccec75-c236-48e7-9de2-35ac2069222f tempest-VolumesActionsTest-1046164172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-caccec75-c236-48e7-9de2-35ac2069222f tempest-VolumesActionsTest-1046164172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:16 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b23027e-ef67-4b44-a63b-58fc5f403ddc]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-caccec75-c236-48e7-9de2-35ac2069222f tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:16 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18" returned: 0 in 0.602s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:17 devstack sudo[99754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18 Sep 07 13:54:17 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:17 devstack sudo[99753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 Sep 07 13:54:17 devstack sudo[99753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:17 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e.6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18" returned: 0 in 0.420s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18" released by "_delete_snapshot" :: held 2.686s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-0ad1cc27-e32e-488b-a027-3daf0901235e" released by "delete_snapshot" :: held 2.741s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:17 devstack sudo[99753]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-caccec75-c236-48e7-9de2-35ac2069222f tempest-VolumesActionsTest-1046164172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" returned: 0 in 0.661s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:17 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2d4fd3-1754-458a-bfc4-04a4dc196a4c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-caccec75-c236-48e7-9de2-35ac2069222f tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:17 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Created reservations ['e075f607-a9df-4870-be59-cffda03bc4d3', 'e2fcee40-22c7-4c22-8755-ecedcd9c230e', 'fa07082a-6e22-419e-aef9-052689807a5b', '3ea0e991-3a3f-4dc7-b73e-de89a200fd5b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:54:17 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Delete snapshot completed successfully. Sep 07 13:54:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2aaa01d1-7c8c-4d7c-8a25-b6c6a2e88c0e tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-6dd9a6f6-98ac-49ef-bf36-f4e14ea4fc18-delete_snapshot" released by "delete_snapshot" :: held 3.083s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:17 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 Sep 07 13:54:17 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:18 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-caccec75-c236-48e7-9de2-35ac2069222f tempest-VolumesActionsTest-1046164172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" returned: 0 in 0.594s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-caccec75-c236-48e7-9de2-35ac2069222f tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.33244647-d6db-47e9-af59-5c4f907fb7eeowgf9_qj.img {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:18 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.33244647-d6db-47e9-af59-5c4f907fb7eeowgf9_qj.img Sep 07 13:54:18 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-0ad1cc27-e32e-488b-a027-3daf0901235e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-0ad1cc27-e32e-488b-a027-3daf0901235e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-quobyte-0ad1cc27-e32e-488b-a027-3daf0901235e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-0ad1cc27-e32e-488b-a027-3daf0901235e" acquired by "delete_volume" :: waited 0.056s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-ddc5f580-c6cf-468b-ba5a-0b8a2fddcc6f req-31e48538-c99d-4824-a7d5-bce15dfdfed3 tempest-AttachVolumeNegativeTest-257270736 None] Terminate volume connection completed successfully. Sep 07 13:54:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-ddc5f580-c6cf-468b-ba5a-0b8a2fddcc6f req-31e48538-c99d-4824-a7d5-bce15dfdfed3 tempest-AttachVolumeNegativeTest-257270736 None] Deleting attachment 7de14027-2293-4c95-81e1-8ae3120f67c8. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:54:18 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b9cf19-2fc2-4e08-96bb-6f2111237567]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:19 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e Sep 07 13:54:19 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:19 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e" returned: 0 in 1.137s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:20 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e Sep 07 13:54:20 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:20 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0ad1cc27-e32e-488b-a027-3daf0901235e" returned: 0 in 0.881s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-0ad1cc27-e32e-488b-a027-3daf0901235e" released by "delete_volume" :: held 2.250s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:21 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Created reservations ['4b97f0c3-b14d-4ce8-a611-a9fb3b2e2cd4', 'df22b28f-10de-4748-ade1-fd4f778aad2f', 'c785fc95-fca1-4f7a-95e5-0066a3093ebc', 'bb5e04dd-1720-405b-82a8-e65c58dc2761'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:54:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:21 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:54:21 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:22 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.777s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:22 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:54:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Deleted volume successfully. Sep 07 13:54:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5238307-fe94-46cc-8969-d934c25170aa tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-0ad1cc27-e32e-488b-a027-3daf0901235e-delete_volume" released by "delete_volume" :: held 3.803s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-6ba2f96f-cd5f-4801-b52f-16725a565b95 req-74d0fc77-667e-4e3c-9dfe-7d1eacd40574 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Terminate volume connection completed successfully. Sep 07 13:54:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-6ba2f96f-cd5f-4801-b52f-16725a565b95 req-74d0fc77-667e-4e3c-9dfe-7d1eacd40574 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Deleting attachment d8d18916-b214-462e-9b6d-bc8a68be29a8. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:54:24 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:54:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Flow 'volume_create_manager' (b2a8a23a-8330-4d17-87c3-4f5a0333fdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255b00b6-5f37-4c27-8c9f-6d36b1144ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (255b00b6-5f37-4c27-8c9f-6d36b1144ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1016722697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044296df-0f44-430b-b1c4-b29043a71d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11b21df7e094855b91b5954d4a6abc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:24Z,use_quota=True,user_id='3c263f9a6d354c24b9f5e90ce316fd64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53445655-86b0-4a91-b1b1-3a4598ffae42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53445655-86b0-4a91-b1b1-3a4598ffae42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83cb2205-b000-474a-9f4b-e978c6da8100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83cb2205-b000-474a-9f4b-e978c6da8100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '044296df-0f44-430b-b1c4-b29043a71d37', 'volume_name': 'volume-044296df-0f44-430b-b1c4-b29043a71d37', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7060167-ebd3-4913-8d09-20ce5967a660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7060167-ebd3-4913-8d09-20ce5967a660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c24fe6-f6e3-4e42-aa4b-510d43fb8986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:24 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Volume 044296df-0f44-430b-b1c4-b29043a71d37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-044296df-0f44-430b-b1c4-b29043a71d37', 'volume_size': 1} Sep 07 13:54:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Acquiring lock "cinder-3ffc771c-558f-401c-92e2-687fde8f50aa-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Lock "cinder-3ffc771c-558f-401c-92e2-687fde8f50aa-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-caccec75-c236-48e7-9de2-35ac2069222f tempest-VolumesActionsTest-1046164172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.33244647-d6db-47e9-af59-5c4f907fb7eeowgf9_qj.img" returned: 0 in 6.777s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:25 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd7212a-7125-4715-84bc-9ec0c218def4]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-caccec75-c236-48e7-9de2-35ac2069222f tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Acquiring lock "cinder-quobyte-3ffc771c-558f-401c-92e2-687fde8f50aa" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Lock "cinder-quobyte-3ffc771c-558f-401c-92e2-687fde8f50aa" acquired by "delete_volume" :: waited 0.041s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:25 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7080c5-ffee-4f79-a82f-428587211dec]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ffc771c-558f-401c-92e2-687fde8f50aa {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:25 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 Sep 07 13:54:25 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:25 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ffc771c-558f-401c-92e2-687fde8f50aa Sep 07 13:54:25 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:25 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ffc771c-558f-401c-92e2-687fde8f50aa" returned: 0 in 0.430s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ffc771c-558f-401c-92e2-687fde8f50aa {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:25 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ffc771c-558f-401c-92e2-687fde8f50aa Sep 07 13:54:25 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:25 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-caccec75-c236-48e7-9de2-35ac2069222f tempest-VolumesActionsTest-1046164172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" returned: 0 in 0.647s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:25 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-caccec75-c236-48e7-9de2-35ac2069222f tempest-VolumesActionsTest-1046164172 None] Image conversion details: src /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60, size 1024.00 MB, duration 6.78 sec, destination /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.33244647-d6db-47e9-af59-5c4f907fb7eeowgf9_qj.img {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:54:25 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-caccec75-c236-48e7-9de2-35ac2069222f tempest-VolumesActionsTest-1046164172 None] Converted 1024.00 MB image at 151.08 MB/s Sep 07 13:54:25 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-caccec75-c236-48e7-9de2-35ac2069222f tempest-VolumesActionsTest-1046164172 None] 33244647-d6db-47e9-af59-5c4f907fb7ee was raw, no need to convert to raw {{(pid=87444) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 07 13:54:25 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ffc771c-558f-401c-92e2-687fde8f50aa" returned: 0 in 0.282s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Lock "cinder-quobyte-3ffc771c-558f-401c-92e2-687fde8f50aa" released by "delete_volume" :: held 0.763s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:26 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Created reservations ['eaf6f435-8f62-4202-b40f-016e5fbb97b7', 'ea4970e2-622b-407a-8e6b-b49792b15add', '19c7b6a6-47e6-42bb-8f9d-b544e0f6ac0b', 'e6670480-9151-49fd-99e9-6e942a6a6357'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:54:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:26 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:54:26 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:26 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.353s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:26 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:54:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Deleted volume successfully. Sep 07 13:54:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a13d5922-c46f-4abe-83d9-973c194c52b9 tempest-TestServerVolumeAttachScenarioOldVersion-1351106995 None] Lock "cinder-3ffc771c-558f-401c-92e2-687fde8f50aa-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "cinder-e6337d77-f714-4b7d-bcf9-db4b36bd5718-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Lock "cinder-e6337d77-f714-4b7d-bcf9-db4b36bd5718-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "cinder-quobyte-e6337d77-f714-4b7d-bcf9-db4b36bd5718" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Lock "cinder-quobyte-e6337d77-f714-4b7d-bcf9-db4b36bd5718" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:28 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[241e1a0d-2514-41f7-95de-fcb378ff9c4b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:28 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718 Sep 07 13:54:28 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:29 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718" returned: 0 in 0.463s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:29 devstack sudo[99889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718 Sep 07 13:54:29 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:29 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e6337d77-f714-4b7d-bcf9-db4b36bd5718" returned: 0 in 0.337s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Lock "cinder-quobyte-e6337d77-f714-4b7d-bcf9-db4b36bd5718" released by "delete_volume" :: held 0.890s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Created reservations ['dcd46e5a-b694-45f3-aefc-dc77f6c6de06', '47b221a7-6fd2-4cb7-b5ca-6199a6d513be', '6f2f0703-57f3-4449-821d-f1ac13a96fef', 'ef1ba975-f8ab-4059-9aca-1300f95bc2ed'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:29 devstack sudo[99893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:54:29 devstack sudo[99893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:29 devstack sudo[99895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:54:29 devstack sudo[99895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "cinder-5bb7957b-5d91-4ff4-94f1-1fab45728a0c-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Lock "cinder-5bb7957b-5d91-4ff4-94f1-1fab45728a0c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "cinder-quobyte-5bb7957b-5d91-4ff4-94f1-1fab45728a0c" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Lock "cinder-quobyte-5bb7957b-5d91-4ff4-94f1-1fab45728a0c" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd38514-8d27-45fc-b3a9-3890dce833ee]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:30 devstack sudo[99893]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.545s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:54:30 devstack sudo[99895]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:30 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Deleted volume successfully. Sep 07 13:54:30 devstack sudo[99897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c Sep 07 13:54:30 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.497s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 29 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d359e533-b15f-41c8-b5fa-db8ca7c1008b tempest-AttachVolumeNegativeTest-257270736 None] Lock "cinder-e6337d77-f714-4b7d-bcf9-db4b36bd5718-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:30 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c" returned: 0 in 0.440s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:30 devstack sudo[99904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c Sep 07 13:54:30 devstack sudo[99904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:30 devstack sudo[99904]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5bb7957b-5d91-4ff4-94f1-1fab45728a0c" returned: 0 in 0.293s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Lock "cinder-quobyte-5bb7957b-5d91-4ff4-94f1-1fab45728a0c" released by "delete_volume" :: held 0.795s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:30 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Created reservations ['696afae4-91f9-4d8c-b012-e28c8c24f865', '717b0c6d-e235-4271-ad6a-0783f2390d55', '217bd133-cca7-41d3-852a-2bddc2b54ab3', 'eebee319-a3f0-44c8-8c2d-e9379eb6aadd'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:54:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:31 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:54:31 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:31 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.383s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:31 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:54:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Deleted volume successfully. Sep 07 13:54:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-df012bef-de3e-4a63-876c-77cb2dff7fb3 tempest-AttachVolumeNegativeTest-257270736 None] Lock "cinder-5bb7957b-5d91-4ff4-94f1-1fab45728a0c-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "cinder-b0888fc5-ae25-472c-a58d-7010d5b57fbf-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Lock "cinder-b0888fc5-ae25-472c-a58d-7010d5b57fbf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "cinder-quobyte-b0888fc5-ae25-472c-a58d-7010d5b57fbf" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Lock "cinder-quobyte-b0888fc5-ae25-472c-a58d-7010d5b57fbf" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:31 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d89e75-a975-4a41-ba68-ee76ce80b45d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:32 devstack sudo[99910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf Sep 07 13:54:32 devstack sudo[99910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:32 devstack sudo[99910]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf" returned: 0 in 0.444s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:32 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf Sep 07 13:54:32 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:32 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b0888fc5-ae25-472c-a58d-7010d5b57fbf" returned: 0 in 0.293s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Lock "cinder-quobyte-b0888fc5-ae25-472c-a58d-7010d5b57fbf" released by "delete_volume" :: held 0.829s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:32 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Created reservations ['fe2a91de-304f-40ab-9c6b-eb6aac7977ff', 'd64b03bb-096f-45a5-8c04-37433c4557db', '0109e468-3bfb-44f9-ac4d-41fd294d0684', '81553432-f862-4a26-a23b-857131d6beac'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:54:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:32 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:54:32 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:33 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.312s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:54:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Deleted volume successfully. Sep 07 13:54:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f2dfaa30-d08b-4902-ba32-33dac1a9d4f1 tempest-AttachVolumeNegativeTest-257270736 None] Lock "cinder-b0888fc5-ae25-472c-a58d-7010d5b57fbf-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:42 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=88,cinder:SELECT=100,cinder:INSERT=21,cinder:DELETE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:54:43 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=92,cinder:UPDATE=86,cinder:DELETE=12,cinder:INSERT=22 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Flow 'volume_create_manager' (e203730b-0d6a-4fa6-85fc-1956f5c5c069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6a07af-662e-45f8-950e-ac774b937ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db6a07af-662e-45f8-950e-ac774b937ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1175456282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1323a4-3e1a-4339-89b4-e5508ab6e37f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9054cc2bf8546c9b7be099e5679fe3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:44Z,use_quota=True,user_id='7a3bae7ef19146a8a0f3567e7021128c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77e4719-4bba-4fba-aa2d-ce805e9de970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77e4719-4bba-4fba-aa2d-ce805e9de970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c283cc-71e1-47c9-a9cc-5bc9f5764de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7c283cc-71e1-47c9-a9cc-5bc9f5764de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a1323a4-3e1a-4339-89b4-e5508ab6e37f', 'volume_name': 'volume-4a1323a4-3e1a-4339-89b4-e5508ab6e37f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484d432d-939e-4a34-be12-4ead493b39f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (484d432d-939e-4a34-be12-4ead493b39f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd154363-dda5-4ed6-9475-549755decb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Volume 4a1323a4-3e1a-4339-89b4-e5508ab6e37f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a1323a4-3e1a-4339-89b4-e5508ab6e37f', 'volume_size': 1} Sep 07 13:54:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-caccec75-c236-48e7-9de2-35ac2069222f tempest-VolumesActionsTest-1046164172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 33.415s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-caccec75-c236-48e7-9de2-35ac2069222f tempest-VolumesActionsTest-1046164172 None] Uploaded volume to glance image-id: 33244647-d6db-47e9-af59-5c4f907fb7ee. {{(pid=87444) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 13:54:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 26.032s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1016722697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=044296df-0f44-430b-b1c4-b29043a71d37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11b21df7e094855b91b5954d4a6abc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:24Z,use_quota=True,user_id='3c263f9a6d354c24b9f5e90ce316fd64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:54:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Creating volume 044296df-0f44-430b-b1c4-b29043a71d37 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:54:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:54:50 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:54:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-caccec75-c236-48e7-9de2-35ac2069222f tempest-VolumesActionsTest-1046164172 None] Copy volume to image completed successfully. Sep 07 13:54:50 devstack sudo[99971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 1073741824 Sep 07 13:54:50 devstack sudo[99971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:50 devstack sudo[99971]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 1073741824" returned: 0 in 0.558s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:50 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 Sep 07 13:54:51 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:51 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37" returned: 0 in 0.274s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.848s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:54:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1175456282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a1323a4-3e1a-4339-89b4-e5508ab6e37f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e9054cc2bf8546c9b7be099e5679fe3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:54:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:54:44Z,use_quota=True,user_id='7a3bae7ef19146a8a0f3567e7021128c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Creating volume 4a1323a4-3e1a-4339-89b4-e5508ab6e37f {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:54:51 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4a1323a4-3e1a-4339-89b4-e5508ab6e37f 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c24fe6-f6e3-4e42-aa4b-510d43fb8986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-044296df-0f44-430b-b1c4-b29043a71d37', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a81e79-08df-452e-b956-f225374c2ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:51 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4a1323a4-3e1a-4339-89b4-e5508ab6e37f 1073741824 Sep 07 13:54:51 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:51 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Volume volume-044296df-0f44-430b-b1c4-b29043a71d37 (044296df-0f44-430b-b1c4-b29043a71d37): created successfully Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a81e79-08df-452e-b956-f225374c2ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Flow 'volume_create_manager' (b2a8a23a-8330-4d17-87c3-4f5a0333fdf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:51 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e58fc354-2b1b-4930-a577-809b2009b6f8 tempest-VolumesSnapshotTestJSON-292525226 None] Created volume successfully. Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:51 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4a1323a4-3e1a-4339-89b4-e5508ab6e37f 1073741824" returned: 0 in 0.547s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4a1323a4-3e1a-4339-89b4-e5508ab6e37f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:51 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4a1323a4-3e1a-4339-89b4-e5508ab6e37f Sep 07 13:54:51 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:52 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4a1323a4-3e1a-4339-89b4-e5508ab6e37f" returned: 0 in 0.355s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:54:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.454s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd154363-dda5-4ed6-9475-549755decb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a1323a4-3e1a-4339-89b4-e5508ab6e37f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8139be-624c-4d53-ac39-5074e06816eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:54:52 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1986436e-dacf-4c54-ac55-1ce2ae00b6ba]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:52 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Volume volume-4a1323a4-3e1a-4339-89b4-e5508ab6e37f (4a1323a4-3e1a-4339-89b4-e5508ab6e37f): created successfully Sep 07 13:54:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8139be-624c-4d53-ac39-5074e06816eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:54:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Flow 'volume_create_manager' (e203730b-0d6a-4fa6-85fc-1956f5c5c069) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:54:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-433ba3a3-db1e-46ce-9442-21422ef0abfd req-1cb5ef62-a3f6-4b63-b744-601d92b1d3e5 tempest-VolumesGetTestJSON-1290561914 None] Created volume successfully. Sep 07 13:54:52 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 Sep 07 13:54:52 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:52 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" returned: 0 in 0.549s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:52 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcbfb2a-7874-43ae-8568-62e578ee466e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:52 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 Sep 07 13:54:52 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:53 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" returned: 0 in 0.436s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.3d1aa9b6-ebb9-4c40-be2d-97c526131bdetr40uo9q.img {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:53 devstack sudo[100001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.3d1aa9b6-ebb9-4c40-be2d-97c526131bdetr40uo9q.img Sep 07 13:54:53 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Acquiring lock "cinder-4a1323a4-3e1a-4339-89b4-e5508ab6e37f-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Lock "cinder-4a1323a4-3e1a-4339-89b4-e5508ab6e37f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Acquiring lock "cinder-quobyte-4a1323a4-3e1a-4339-89b4-e5508ab6e37f" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:54:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Lock "cinder-quobyte-4a1323a4-3e1a-4339-89b4-e5508ab6e37f" acquired by "delete_volume" :: waited 0.058s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:54:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0093343-ff14-4911-a979-43f356edcf32]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4a1323a4-3e1a-4339-89b4-e5508ab6e37f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:54 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4a1323a4-3e1a-4339-89b4-e5508ab6e37f Sep 07 13:54:54 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:55 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4a1323a4-3e1a-4339-89b4-e5508ab6e37f" returned: 0 in 1.194s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4a1323a4-3e1a-4339-89b4-e5508ab6e37f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:55 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4a1323a4-3e1a-4339-89b4-e5508ab6e37f Sep 07 13:54:55 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:55 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4a1323a4-3e1a-4339-89b4-e5508ab6e37f" returned: 0 in 0.625s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Lock "cinder-quobyte-4a1323a4-3e1a-4339-89b4-e5508ab6e37f" released by "delete_volume" :: held 1.953s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:55 devstack cinder-volume[87444]: DEBUG cinder.quota [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Created reservations ['c2203030-b813-48f6-91dc-83ce4c62d1bf', '0e19152e-5966-4bdb-9c2c-5eb9e580019d', '3e40710a-61c8-4b29-96a8-261413978cb2', 'b6cdbf40-0af7-4ad9-bbbc-91c835936e65'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:54:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:54:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:54:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:54:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:54:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:54:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:56 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:54:56 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:56 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.882s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:56 devstack cinder-volume[87444]: DEBUG cinder.manager [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:54:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Deleted volume successfully. Sep 07 13:54:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-d7166c5f-b429-4cd3-be84-a162c0522d4b req-5bc06ce3-80cb-4f3b-aa61-136824299502 tempest-VolumesGetTestJSON-1290561914 None] Lock "cinder-4a1323a4-3e1a-4339-89b4-e5508ab6e37f-delete_volume" released by "delete_volume" :: held 3.498s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:54:59 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.3d1aa9b6-ebb9-4c40-be2d-97c526131bdetr40uo9q.img" returned: 0 in 6.004s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:59 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb339000-7de8-4872-8fd1-3700638594a7]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:54:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:54:59 devstack sudo[100033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 Sep 07 13:54:59 devstack sudo[100033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:54:59 devstack sudo[100033]: pam_unix(sudo:session): session closed for user root Sep 07 13:54:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" returned: 0 in 0.674s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:54:59 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Image conversion details: src /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.3d1aa9b6-ebb9-4c40-be2d-97c526131bdetr40uo9q.img {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:54:59 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Converted 1024.00 MB image at 170.52 MB/s Sep 07 13:54:59 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] 3d1aa9b6-ebb9-4c40-be2d-97c526131bde was raw, converting to qcow2 {{(pid=87444) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 07 13:55:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf577489-38e1-4a00-945b-a3f0a8371e49]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.3d1aa9b6-ebb9-4c40-be2d-97c526131bdetr40uo9q.img {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:00 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.3d1aa9b6-ebb9-4c40-be2d-97c526131bdetr40uo9q.img Sep 07 13:55:00 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:00 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.3d1aa9b6-ebb9-4c40-be2d-97c526131bdetr40uo9q.img" returned: 0 in 0.477s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.3d1aa9b6-ebb9-4c40-be2d-97c526131bdetr40uo9q.img {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:00 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.3d1aa9b6-ebb9-4c40-be2d-97c526131bdetr40uo9q.img Sep 07 13:55:00 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:01 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.3d1aa9b6-ebb9-4c40-be2d-97c526131bdetr40uo9q.img" returned: 1 in 0.567s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.3d1aa9b6-ebb9-4c40-be2d-97c526131bdetr40uo9q.img' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:55:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.3d1aa9b6-ebb9-4c40-be2d-97c526131bdetr40uo9q.img /opt/stack/data/cinder/conversion/vol_upload_l635tzh6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:01 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.3d1aa9b6-ebb9-4c40-be2d-97c526131bdetr40uo9q.img /opt/stack/data/cinder/conversion/vol_upload_l635tzh6 Sep 07 13:55:01 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:01 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.3d1aa9b6-ebb9-4c40-be2d-97c526131bdetr40uo9q.img /opt/stack/data/cinder/conversion/vol_upload_l635tzh6" returned: 0 in 0.425s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:01 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Image conversion details: src /opt/stack/data/cinder/conversion/51e419c9-f5d1-4a1a-99a8-3a5a67611c60.temp_image.3d1aa9b6-ebb9-4c40-be2d-97c526131bdetr40uo9q.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_l635tzh6 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:55:01 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 07 13:55:01 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e48edb8-1dcd-4335-9dbd-81785b656557]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l635tzh6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:01 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l635tzh6 Sep 07 13:55:01 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:01 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_l635tzh6" returned: 0 in 0.495s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.582s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Uploaded volume to glance image-id: 3d1aa9b6-ebb9-4c40-be2d-97c526131bde. {{(pid=87444) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 13:55:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.117s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] Creating offline snapshot e5c861a7-931f-438a-8baf-0ca454061bc2 of volume 044296df-0f44-430b-b1c4-b29043a71d37 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:55:03 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3df4719e-0b8d-4065-ad0b-aca36272d404 tempest-VolumesActionsTest-1046164172 None] Copy volume to image completed successfully. Sep 07 13:55:03 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[784ecd2f-db10-4a53-a49b-28982e567ef8]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:03 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 Sep 07 13:55:03 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:04 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37" returned: 0 in 0.461s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:04 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 1G Sep 07 13:55:04 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:04 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 1G" returned: 0 in 0.637s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-044296df-0f44-430b-b1c4-b29043a71d37 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:04 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-044296df-0f44-430b-b1c4-b29043a71d37 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 Sep 07 13:55:04 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:05 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-044296df-0f44-430b-b1c4-b29043a71d37 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2" returned: 0 in 0.425s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:05 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 is being set with open permissions: ugo+rw Sep 07 13:55:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:05 devstack sudo[100414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 Sep 07 13:55:05 devstack sudo[100414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Acquiring lock "cinder-51e419c9-f5d1-4a1a-99a8-3a5a67611c60-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Lock "cinder-51e419c9-f5d1-4a1a-99a8-3a5a67611c60-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Acquiring lock "cinder-quobyte-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Lock "cinder-quobyte-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[553fc609-227b-488e-8979-39525e6009be]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:05 devstack sudo[100414]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2" returned: 0 in 0.350s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:05 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 Sep 07 13:55:05 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:05 devstack sudo[100419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.info Sep 07 13:55:05 devstack sudo[100419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:06 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" returned: 0 in 0.481s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:06 devstack sudo[100419]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.info" returned: 0 in 0.334s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:06 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.info is being set with open permissions: ugo+rw Sep 07 13:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:06 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60 Sep 07 13:55:06 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:06 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.info Sep 07 13:55:06 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:06 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:06 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" returned: 0 in 0.323s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.info" returned: 0 in 0.306s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.688s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Lock "cinder-quobyte-51e419c9-f5d1-4a1a-99a8-3a5a67611c60" released by "delete_volume" :: held 0.887s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6c6b8beb-6d3f-4218-b452-5589b194689d tempest-VolumesSnapshotTestJSON-292525226 None] Create snapshot completed successfully Sep 07 13:55:06 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Created reservations ['b1c9e4ae-f5b7-4b32-82e2-9a7306d4882f', '6f2d7e95-0c0a-4b55-8f10-3be2908ac267', 'bc640236-6888-432e-9f2f-28705166143e', '49f98d43-8cfa-4420-a5d8-1e81a152fd3d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:06 devstack sudo[100432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:55:06 devstack sudo[100432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:07 devstack sudo[100432]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.322s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:55:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Deleted volume successfully. Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b99211d4-07cc-4ea3-a7a5-e5f1fca3838a tempest-VolumesActionsTest-1046164172 None] Lock "cinder-51e419c9-f5d1-4a1a-99a8-3a5a67611c60-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Flow 'volume_create_manager' (ab2f9e8d-9eb3-4ecb-89c9-d78eb13de3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35c08bc-cdeb-4400-934b-095c37519a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c35c08bc-cdeb-4400-934b-095c37519a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-364493253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2506aba-6d19-4dfd-a64a-9b9141ae746b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11b21df7e094855b91b5954d4a6abc2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e5c861a7-931f-438a-8baf-0ca454061bc2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:07Z,use_quota=True,user_id='3c263f9a6d354c24b9f5e90ce316fd64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a7a234-86f2-423f-a8b7-3732ff583a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1a7a234-86f2-423f-a8b7-3732ff583a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022dcb62-e080-4a66-b214-d435748c380c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (022dcb62-e080-4a66-b214-d435748c380c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e2506aba-6d19-4dfd-a64a-9b9141ae746b', 'volume_name': 'volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b', 'volume_size': 1, 'snapshot_id': 'e5c861a7-931f-438a-8baf-0ca454061bc2'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f9f4e1-f58c-4813-a666-a70c720f4645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06f9f4e1-f58c-4813-a666-a70c720f4645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4df9563-7a6b-4774-b966-6856853eb5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:07 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Volume e2506aba-6d19-4dfd-a64a-9b9141ae746b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b', 'volume_size': 1, 'snapshot_id': 'e5c861a7-931f-438a-8baf-0ca454061bc2'} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-quobyte-e5c861a7-931f-438a-8baf-0ca454061bc2-e2506aba-6d19-4dfd-a64a-9b9141ae746b" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-e5c861a7-931f-438a-8baf-0ca454061bc2-e2506aba-6d19-4dfd-a64a-9b9141ae746b" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Creating volume e2506aba-6d19-4dfd-a64a-9b9141ae746b from snapshot e5c861a7-931f-438a-8baf-0ca454061bc2 {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-quobyte-e2506aba-6d19-4dfd-a64a-9b9141ae746b" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-e2506aba-6d19-4dfd-a64a-9b9141ae746b" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] snapshot: e5c861a7-931f-438a-8baf-0ca454061bc2, volume: e2506aba-6d19-4dfd-a64a-9b9141ae746b, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[28038331-f36a-4638-b8fc-3a08ffe7567e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:07 devstack sudo[100435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 Sep 07 13:55:07 devstack sudo[100435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:08 devstack sudo[100435]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2" returned: 0 in 0.440s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-044296df-0f44-430b-b1c4-b29043a71d37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:55:08 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a54621-08da-4e4d-a7b5-7befe8fe0251]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:08 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 Sep 07 13:55:08 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:08 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37" returned: 0 in 0.383s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] will copy from snapshot at /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:55:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:55:08 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Path /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:55:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:08 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b Sep 07 13:55:08 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:14 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b" returned: 0 in 5.994s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:14 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Image conversion details: src /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37, size 1024.00 MB, duration 5.99 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:55:14 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Converted 1024.00 MB image at 170.81 MB/s Sep 07 13:55:14 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b is being set with open permissions: ugo+rw Sep 07 13:55:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:14 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b Sep 07 13:55:14 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:14 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b" returned: 0 in 0.295s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-e2506aba-6d19-4dfd-a64a-9b9141ae746b" released by "_copy_volume_from_snapshot" :: held 7.236s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-e5c861a7-931f-438a-8baf-0ca454061bc2-e2506aba-6d19-4dfd-a64a-9b9141ae746b" released by "_create_volume_from_snapshot" :: held 7.318s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.351s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4df9563-7a6b-4774-b966-6856853eb5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b', 'volume_size': 1, 'snapshot_id': 'e5c861a7-931f-438a-8baf-0ca454061bc2'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f10b143-d2e0-44d3-911b-4182df62f5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:15 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Volume volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b (e2506aba-6d19-4dfd-a64a-9b9141ae746b): created successfully Sep 07 13:55:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f10b143-d2e0-44d3-911b-4182df62f5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Flow 'volume_create_manager' (ab2f9e8d-9eb3-4ecb-89c9-d78eb13de3af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:15 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-827a0715-1b34-4adb-a915-f46dbc634858 tempest-VolumesSnapshotTestJSON-292525226 None] Created volume successfully. Sep 07 13:55:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-e2506aba-6d19-4dfd-a64a-9b9141ae746b-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-e2506aba-6d19-4dfd-a64a-9b9141ae746b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-quobyte-e2506aba-6d19-4dfd-a64a-9b9141ae746b" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-e2506aba-6d19-4dfd-a64a-9b9141ae746b" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:15 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f418a8-61f2-4af1-899e-7b451c70f106]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:15 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b Sep 07 13:55:15 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:16 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b" returned: 0 in 0.448s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:16 devstack sudo[100557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b Sep 07 13:55:16 devstack sudo[100557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:16 devstack sudo[100557]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e2506aba-6d19-4dfd-a64a-9b9141ae746b" returned: 0 in 0.279s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-e2506aba-6d19-4dfd-a64a-9b9141ae746b" released by "delete_volume" :: held 0.771s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Created reservations ['326f7a7d-79de-45ef-a5f2-10fbded0aadf', 'ace7a635-9e0f-4a4c-b4a3-203681c235df', 'e0525f42-194b-4531-9385-8cb573c8ef48', '9daa0fb6-8af8-42a9-a9d2-5dd63ed06f5e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:16 devstack sudo[100560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:55:16 devstack sudo[100560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-e5c861a7-931f-438a-8baf-0ca454061bc2-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-e5c861a7-931f-438a-8baf-0ca454061bc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-quobyte-044296df-0f44-430b-b1c4-b29043a71d37" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:16 devstack sudo[100560]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.390s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:55:16 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Deleted volume successfully. Sep 07 13:55:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-044296df-0f44-430b-b1c4-b29043a71d37" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-quobyte-e5c861a7-931f-438a-8baf-0ca454061bc2" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-e5c861a7-931f-438a-8baf-0ca454061bc2" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Deleting offline snapshot e5c861a7-931f-438a-8baf-0ca454061bc2 of volume 044296df-0f44-430b-b1c4-b29043a71d37 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:55:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] snapshot_file for this snap is: volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:55:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aabfa3e3-8d15-4bb3-b890-d02d0878f8e6 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-e2506aba-6d19-4dfd-a64a-9b9141ae746b-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:17 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e27c698-a773-43bb-acce-f3d2a081ddb4]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:17 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 Sep 07 13:55:17 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:17 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2" returned: 0 in 0.481s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-044296df-0f44-430b-b1c4-b29043a71d37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:55:17 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d890f62c-cf80-44c6-bf6d-275bd86ed49a]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:17 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 Sep 07 13:55:17 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:18 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37" returned: 0 in 0.646s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:18 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 Sep 07 13:55:18 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:18 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2" returned: 0 in 0.464s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:18 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2 Sep 07 13:55:18 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:19 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37.e5c861a7-931f-438a-8baf-0ca454061bc2" returned: 0 in 0.348s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-e5c861a7-931f-438a-8baf-0ca454061bc2" released by "_delete_snapshot" :: held 2.164s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-044296df-0f44-430b-b1c4-b29043a71d37" released by "delete_snapshot" :: held 2.198s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Created reservations ['a785c4d3-0d55-4647-90f7-e717e956ed66', 'bd9e434c-ab15-4557-aaf8-3549d55339f3', 'af983feb-1f3f-4ba1-adf5-ce0597513790', '083003da-deed-4fdf-add6-ab93433bcec2'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:55:19 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Delete snapshot completed successfully. Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ab384ec0-59e4-41b6-80f7-499a0a3cbbbc tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-e5c861a7-931f-438a-8baf-0ca454061bc2-delete_snapshot" released by "delete_snapshot" :: held 2.445s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Flow 'volume_create_manager' (5f9ad5b3-e38c-4573-b74a-19c87dfeb4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe905543-6fe2-4c01-b03e-a1248bc97d27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe905543-6fe2-4c01-b03e-a1248bc97d27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-830043941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ff0ffd-ae47-4b54-9b71-50b3409138a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a3a43e5c26486a9f86060e60fd60ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:20Z,use_quota=True,user_id='8032ecd22d4e4de3bfbfd59d8b81121d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77cdfa0-7e1e-4771-b56b-c7af9b3fbc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77cdfa0-7e1e-4771-b56b-c7af9b3fbc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3440072-431c-4b48-af16-b320f8f601ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3440072-431c-4b48-af16-b320f8f601ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5ff0ffd-ae47-4b54-9b71-50b3409138a8', 'volume_name': 'volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da825279-6542-4530-bb21-d382dfbc35ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da825279-6542-4530-bb21-d382dfbc35ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8afc478e-4520-4f50-b01b-43fbb3f03e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:19 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Volume e5ff0ffd-ae47-4b54-9b71-50b3409138a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8', 'volume_size': 1} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-830043941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5ff0ffd-ae47-4b54-9b71-50b3409138a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97a3a43e5c26486a9f86060e60fd60ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:20Z,use_quota=True,user_id='8032ecd22d4e4de3bfbfd59d8b81121d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Creating volume e5ff0ffd-ae47-4b54-9b71-50b3409138a8 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:55:19 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:19 devstack sudo[100584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 1073741824 Sep 07 13:55:19 devstack sudo[100584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-044296df-0f44-430b-b1c4-b29043a71d37-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-044296df-0f44-430b-b1c4-b29043a71d37-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:20 devstack sudo[100584]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 1073741824" returned: 0 in 0.621s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-quobyte-044296df-0f44-430b-b1c4-b29043a71d37" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:20 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 Sep 07 13:55:20 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-044296df-0f44-430b-b1c4-b29043a71d37" acquired by "delete_volume" :: waited 0.033s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:20 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83731a6-b3bc-478a-b966-6d7d88103767]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:20 devstack sudo[100592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 Sep 07 13:55:20 devstack sudo[100592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:20 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8" returned: 0 in 0.318s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:55:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8afc478e-4520-4f50-b01b-43fbb3f03e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7cc17d6-1106-4a40-b8f1-433df983ab27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:20 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Volume volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 (e5ff0ffd-ae47-4b54-9b71-50b3409138a8): created successfully Sep 07 13:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7cc17d6-1106-4a40-b8f1-433df983ab27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Flow 'volume_create_manager' (5f9ad5b3-e38c-4573-b74a-19c87dfeb4b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-43b9b43b-8390-4226-9bb6-4e3ea3b52c91 tempest-TestImageHashVerification-2034735763 None] Created volume successfully. Sep 07 13:55:21 devstack sudo[100592]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37" returned: 0 in 0.469s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:21 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37 Sep 07 13:55:21 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:21 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-044296df-0f44-430b-b1c4-b29043a71d37" returned: 0 in 0.342s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-044296df-0f44-430b-b1c4-b29043a71d37" released by "delete_volume" :: held 0.874s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:21 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Created reservations ['a97ac74b-2ef2-4171-bc71-16f321e83183', '49dbefe7-8936-4f4c-8729-618375ec0063', 'e9fe1081-bd9d-4c48-8816-505a097f6616', '18c0d482-3f4e-415b-a8bc-585c17f4f118'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:55:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:21 devstack sudo[100601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:55:21 devstack sudo[100601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:21 devstack sudo[100601]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.316s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:21 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:55:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Deleted volume successfully. Sep 07 13:55:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fb85272-dcd4-42af-b023-0d80d82aefa4 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-044296df-0f44-430b-b1c4-b29043a71d37-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-22121ac4-9321-4341-9340-2d96fbd86607-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-22121ac4-9321-4341-9340-2d96fbd86607-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "cinder-quobyte-22121ac4-9321-4341-9340-2d96fbd86607" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-22121ac4-9321-4341-9340-2d96fbd86607" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca42d230-af55-4c78-8d15-a171681a6fa1]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1f628285-c3de-4a71-9b42-71c18ddf696b tempest-TestImageHashVerification-2034735763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1f628285-c3de-4a71-9b42-71c18ddf696b tempest-TestImageHashVerification-2034735763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5359fd-968e-43e3-9b19-bde5fa71209b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1f628285-c3de-4a71-9b42-71c18ddf696b tempest-TestImageHashVerification-2034735763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:23 devstack sudo[100605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607 Sep 07 13:55:23 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:23 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 Sep 07 13:55:23 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:23 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607" returned: 0 in 0.472s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:23 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607 Sep 07 13:55:23 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:23 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1f628285-c3de-4a71-9b42-71c18ddf696b tempest-TestImageHashVerification-2034735763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8" returned: 0 in 0.513s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[90988d4b-3c40-40f9-95cc-a14eecab8e3d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1f628285-c3de-4a71-9b42-71c18ddf696b tempest-TestImageHashVerification-2034735763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:23 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-22121ac4-9321-4341-9340-2d96fbd86607" returned: 0 in 0.328s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-quobyte-22121ac4-9321-4341-9340-2d96fbd86607" released by "delete_volume" :: held 0.890s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:23 devstack sudo[100618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 Sep 07 13:55:23 devstack sudo[100618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:23 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Created reservations ['4f71cc3a-9a36-4ada-9596-643d1937e977', '02b3a369-4fc1-4870-aef8-1d4c79e8f801', '00615b3e-710b-40a4-8504-a67947f239fb', 'cdc6b0a2-5f0a-4008-a67d-0c64b3cf1442'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:23 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:55:23 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:24 devstack sudo[100618]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1f628285-c3de-4a71-9b42-71c18ddf696b tempest-TestImageHashVerification-2034735763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8" returned: 0 in 0.610s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1f628285-c3de-4a71-9b42-71c18ddf696b tempest-TestImageHashVerification-2034735763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 /opt/stack/data/cinder/conversion/e5ff0ffd-ae47-4b54-9b71-50b3409138a8.temp_image.633474b4-0fc7-4927-a48f-7968a8c1d45an48ldm6j.img {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:24 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 /opt/stack/data/cinder/conversion/e5ff0ffd-ae47-4b54-9b71-50b3409138a8.temp_image.633474b4-0fc7-4927-a48f-7968a8c1d45an48ldm6j.img Sep 07 13:55:24 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:24 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.557s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:55:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Deleted volume successfully. Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-57d2cec0-0c32-4e20-9378-63fcfdaf3e74 tempest-VolumesSnapshotTestJSON-292525226 None] Lock "cinder-22121ac4-9321-4341-9340-2d96fbd86607-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Flow 'volume_create_manager' (42815ae8-2ba3-4b46-a369-70f0ace82a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7d1168-dafe-4f0a-90e6-d8cf0630a934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b7d1168-dafe-4f0a-90e6-d8cf0630a934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1363187680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b269261-b1fc-4e09-a2d4-ae43bdcec933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601c45af1f4e406f9b97d798bd2f5928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:25Z,use_quota=True,user_id='e943901fe25a4f6996e30f969e84c63b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6a2c01-d3d0-4d73-ae28-007f245d9588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6a2c01-d3d0-4d73-ae28-007f245d9588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34760b60-584e-47b8-915c-1d6eb7c1da6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34760b60-584e-47b8-915c-1d6eb7c1da6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b269261-b1fc-4e09-a2d4-ae43bdcec933', 'volume_name': 'volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ac4399-073a-438a-8c5f-678918bbc6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1ac4399-073a-438a-8c5f-678918bbc6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc27a65-e882-424b-b221-55458e2822e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:24 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Volume 1b269261-b1fc-4e09-a2d4-ae43bdcec933: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933', 'volume_size': 1} Sep 07 13:55:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:55:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:29 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:55:29 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:29 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1f628285-c3de-4a71-9b42-71c18ddf696b tempest-TestImageHashVerification-2034735763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 /opt/stack/data/cinder/conversion/e5ff0ffd-ae47-4b54-9b71-50b3409138a8.temp_image.633474b4-0fc7-4927-a48f-7968a8c1d45an48ldm6j.img" returned: 0 in 5.824s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:30 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[148add37-98a2-44b6-8aef-f959ddc7defb]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1f628285-c3de-4a71-9b42-71c18ddf696b tempest-TestImageHashVerification-2034735763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:30 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 Sep 07 13:55:30 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:30 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.368s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:55:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:55:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 29 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:55:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:55:30 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1f628285-c3de-4a71-9b42-71c18ddf696b tempest-TestImageHashVerification-2034735763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8" returned: 0 in 0.620s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:30 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-1f628285-c3de-4a71-9b42-71c18ddf696b tempest-TestImageHashVerification-2034735763 None] Image conversion details: src /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8, size 1024.00 MB, duration 5.83 sec, destination /opt/stack/data/cinder/conversion/e5ff0ffd-ae47-4b54-9b71-50b3409138a8.temp_image.633474b4-0fc7-4927-a48f-7968a8c1d45an48ldm6j.img {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:55:30 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-1f628285-c3de-4a71-9b42-71c18ddf696b tempest-TestImageHashVerification-2034735763 None] Converted 1024.00 MB image at 175.75 MB/s Sep 07 13:55:30 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-1f628285-c3de-4a71-9b42-71c18ddf696b tempest-TestImageHashVerification-2034735763 None] 633474b4-0fc7-4927-a48f-7968a8c1d45a was raw, no need to convert to raw {{(pid=87444) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 07 13:55:36 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:55:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Flow 'volume_create_manager' (101769c9-fc41-4b33-bc98-0395e4c60498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1bbe19-455e-4f0b-a1c9-cbad4c049146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef1bbe19-455e-4f0b-a1c9-cbad4c049146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-431338014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d795ed2a-c36a-42d4-b136-1c078af6d900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9eb40ea2efb4985a820fe3b036271e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:37Z,use_quota=True,user_id='52b9ba93b1a84981a94238ac532d99dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5163c820-6211-46f9-b2c9-b49f6f8c29c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5163c820-6211-46f9-b2c9-b49f6f8c29c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f437b02e-c5d5-438c-88d2-a1f9dab4d49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f437b02e-c5d5-438c-88d2-a1f9dab4d49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd795ed2a-c36a-42d4-b136-1c078af6d900', 'volume_name': 'volume-d795ed2a-c36a-42d4-b136-1c078af6d900', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a643ed3a-e9fd-4016-9594-190b83e5b1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a643ed3a-e9fd-4016-9594-190b83e5b1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c152dbc0-9f3f-4e62-b616-a8cba692e4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:36 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Volume d795ed2a-c36a-42d4-b136-1c078af6d900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d795ed2a-c36a-42d4-b136-1c078af6d900', 'volume_size': 1} Sep 07 13:55:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:46 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=46,cinder:UPDATE=61,cinder:DELETE=9,cinder:INSERT=13 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:55:46 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=52,cinder:UPDATE=61,cinder:INSERT=16,cinder:DELETE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:55:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1f628285-c3de-4a71-9b42-71c18ddf696b tempest-TestImageHashVerification-2034735763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.807s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1f628285-c3de-4a71-9b42-71c18ddf696b tempest-TestImageHashVerification-2034735763 None] Uploaded volume to glance image-id: 633474b4-0fc7-4927-a48f-7968a8c1d45a. {{(pid=87444) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 07 13:55:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1363187680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b269261-b1fc-4e09-a2d4-ae43bdcec933,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601c45af1f4e406f9b97d798bd2f5928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:25Z,use_quota=True,user_id='e943901fe25a4f6996e30f969e84c63b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:55:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Creating volume 1b269261-b1fc-4e09-a2d4-ae43bdcec933 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:55:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:55:52 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:55:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1f628285-c3de-4a71-9b42-71c18ddf696b tempest-TestImageHashVerification-2034735763 None] Copy volume to image completed successfully. Sep 07 13:55:52 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 1073741824 Sep 07 13:55:52 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:53 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 1073741824" returned: 0 in 0.465s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:53 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 Sep 07 13:55:53 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:53 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933" returned: 0 in 0.296s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.673s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-431338014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d795ed2a-c36a-42d4-b136-1c078af6d900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9eb40ea2efb4985a820fe3b036271e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:37Z,use_quota=True,user_id='52b9ba93b1a84981a94238ac532d99dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Creating volume d795ed2a-c36a-42d4-b136-1c078af6d900 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:55:53 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d795ed2a-c36a-42d4-b136-1c078af6d900 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:53 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d795ed2a-c36a-42d4-b136-1c078af6d900 1073741824 Sep 07 13:55:53 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fc27a65-e882-424b-b221-55458e2822e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59b5f10-4dd9-478b-9f54-c14b3c86409c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Volume volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 (1b269261-b1fc-4e09-a2d4-ae43bdcec933): created successfully Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e59b5f10-4dd9-478b-9f54-c14b3c86409c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Flow 'volume_create_manager' (42815ae8-2ba3-4b46-a369-70f0ace82a98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e67bbbf9-0052-4367-829f-5b20a46ae886 tempest-VolumesCloneTest-162813763 None] Created volume successfully. Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Acquiring lock "cinder-e5ff0ffd-ae47-4b54-9b71-50b3409138a8-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Lock "cinder-e5ff0ffd-ae47-4b54-9b71-50b3409138a8-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Acquiring lock "cinder-quobyte-e5ff0ffd-ae47-4b54-9b71-50b3409138a8" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Lock "cinder-quobyte-e5ff0ffd-ae47-4b54-9b71-50b3409138a8" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a049d4f4-1e7c-4479-ac6d-cf347066e7f2]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:54 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d795ed2a-c36a-42d4-b136-1c078af6d900 1073741824" returned: 0 in 0.628s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d795ed2a-c36a-42d4-b136-1c078af6d900 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:54 devstack sudo[100711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 Sep 07 13:55:54 devstack sudo[100711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:54 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d795ed2a-c36a-42d4-b136-1c078af6d900 Sep 07 13:55:54 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:54 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d795ed2a-c36a-42d4-b136-1c078af6d900" returned: 0 in 0.282s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:54 devstack sudo[100711]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c152dbc0-9f3f-4e62-b616-a8cba692e4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d795ed2a-c36a-42d4-b136-1c078af6d900', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8f07af-34b7-4005-aad8-27712b0571d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8" returned: 0 in 0.444s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:54 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Volume volume-d795ed2a-c36a-42d4-b136-1c078af6d900 (d795ed2a-c36a-42d4-b136-1c078af6d900): created successfully Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d8f07af-34b7-4005-aad8-27712b0571d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:54 devstack sudo[100719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8 Sep 07 13:55:54 devstack sudo[100719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Flow 'volume_create_manager' (101769c9-fc41-4b33-bc98-0395e4c60498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d1053c9a-f914-49f1-8f84-0c665d5ae551 tempest-VolumesServicesTestJSON-1738978532 None] Created volume successfully. Sep 07 13:55:54 devstack sudo[100719]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e5ff0ffd-ae47-4b54-9b71-50b3409138a8" returned: 0 in 0.358s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Lock "cinder-quobyte-e5ff0ffd-ae47-4b54-9b71-50b3409138a8" released by "delete_volume" :: held 0.856s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Created reservations ['6385b55b-e53e-4376-b2c6-e8caec693867', 'dc530ae4-5306-47ac-b3e3-c837958ed30f', 'd523b2d8-36ce-4ac9-bde3-1ae13ce51cee', '85459388-22c6-4510-bccf-bde149da43b3'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:55 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:55:55 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Flow 'volume_create_manager' (81e2d045-20b8-4540-8aa9-46c94870f11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6c4bf0-edef-4647-a80c-1d29c17a0bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6c4bf0-edef-4647-a80c-1d29c17a0bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:55:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1172367751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c3600d-6e58-4324-b39f-263d59ddf31a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='601c45af1f4e406f9b97d798bd2f5928',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:55:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1b269261-b1fc-4e09-a2d4-ae43bdcec933,status='creating',terminated_at=None,updated_at=2026-09-07T11:55:55Z,use_quota=True,user_id='e943901fe25a4f6996e30f969e84c63b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68f35ef-db17-48a7-8e8f-c1a369bf870b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68f35ef-db17-48a7-8e8f-c1a369bf870b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25191987-c26d-446e-bae9-0eae486dfcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25191987-c26d-446e-bae9-0eae486dfcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c3c3600d-6e58-4324-b39f-263d59ddf31a', 'volume_name': 'volume-c3c3600d-6e58-4324-b39f-263d59ddf31a', 'volume_size': 2, 'source_volid': '1b269261-b1fc-4e09-a2d4-ae43bdcec933', 'source_volstatus': 'available'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a83a90-ff8c-4085-96b8-57ff8182fe50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a83a90-ff8c-4085-96b8-57ff8182fe50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdd6030-dd1d-498a-abf9-b117487569b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:55:55 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Volume c3c3600d-6e58-4324-b39f-263d59ddf31a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c3c3600d-6e58-4324-b39f-263d59ddf31a', 'volume_size': 2, 'source_volid': '1b269261-b1fc-4e09-a2d4-ae43bdcec933', 'source_volstatus': 'available'} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:55 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Cloning volume 1b269261-b1fc-4e09-a2d4-ae43bdcec933 to volume c3c3600d-6e58-4324-b39f-263d59ddf31a Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Acquiring lock "cinder-d795ed2a-c36a-42d4-b136-1c078af6d900-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Creating offline snapshot fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 of volume 1b269261-b1fc-4e09-a2d4-ae43bdcec933 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Lock "cinder-d795ed2a-c36a-42d4-b136-1c078af6d900-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac7c04e-09bc-4c5d-b545-414d457cacfa]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:55 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.417s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Acquiring lock "cinder-quobyte-d795ed2a-c36a-42d4-b136-1c078af6d900" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:55 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Deleted volume successfully. Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Lock "cinder-quobyte-d795ed2a-c36a-42d4-b136-1c078af6d900" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-71022f92-c323-4ce2-b659-b5d187a5645a tempest-TestImageHashVerification-2034735763 None] Lock "cinder-e5ff0ffd-ae47-4b54-9b71-50b3409138a8-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ba92c0-27b7-49b5-b886-4c36f220d063]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d795ed2a-c36a-42d4-b136-1c078af6d900 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:55 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 Sep 07 13:55:55 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:55 devstack sudo[100726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d795ed2a-c36a-42d4-b136-1c078af6d900 Sep 07 13:55:55 devstack sudo[100726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:56 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933" returned: 0 in 0.466s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:56 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 1G Sep 07 13:55:56 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:56 devstack sudo[100726]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d795ed2a-c36a-42d4-b136-1c078af6d900" returned: 0 in 0.524s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d795ed2a-c36a-42d4-b136-1c078af6d900 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:56 devstack sudo[100737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d795ed2a-c36a-42d4-b136-1c078af6d900 Sep 07 13:55:56 devstack sudo[100737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:56 devstack sudo[100737]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d795ed2a-c36a-42d4-b136-1c078af6d900" returned: 0 in 0.307s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:56 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 1G" returned: 0 in 0.523s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Lock "cinder-quobyte-d795ed2a-c36a-42d4-b136-1c078af6d900" released by "delete_volume" :: held 0.915s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:56 devstack sudo[100744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 Sep 07 13:55:56 devstack sudo[100744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:56 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Created reservations ['5ad62ea7-76db-40a2-9e37-e95ec070bc2b', '73de900e-43b3-498b-be6d-f797b2a7863e', '928eebf9-4319-4a80-8afe-19bcbb79cce5', '23ea2d61-b479-42f2-a90f-c431f4455720'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:56 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:55:56 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:57 devstack sudo[100744]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9" returned: 0 in 0.526s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:57 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 is being set with open permissions: ugo+rw Sep 07 13:55:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:57 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 Sep 07 13:55:57 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:57 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.435s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:57 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:55:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Deleted volume successfully. Sep 07 13:55:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e54b545e-f68b-4c5f-bce6-0a8dafd599ac tempest-VolumesServicesTestJSON-1738978532 None] Lock "cinder-d795ed2a-c36a-42d4-b136-1c078af6d900-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:55:57 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9" returned: 0 in 0.409s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:57 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.info Sep 07 13:55:57 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:57 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.info" returned: 0 in 0.413s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:57 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.info is being set with open permissions: ugo+rw Sep 07 13:55:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:57 devstack sudo[100765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.info Sep 07 13:55:57 devstack sudo[100765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:58 devstack sudo[100765]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.info" returned: 0 in 0.437s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Acquiring lock "cinder-quobyte-c3c3600d-6e58-4324-b39f-263d59ddf31a" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:55:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Lock "cinder-quobyte-c3c3600d-6e58-4324-b39f-263d59ddf31a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:55:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] snapshot: fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9, volume: c3c3600d-6e58-4324-b39f-263d59ddf31a, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:55:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:55:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:55:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:55:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:55:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:55:58 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f02c35-cf98-4dfd-abb5-49066d265660]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:58 devstack sudo[100768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 Sep 07 13:55:58 devstack sudo[100768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:58 devstack sudo[100768]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9" returned: 0 in 0.475s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:55:58 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40145aa-c4f7-4a0f-bb6b-75475cc11866]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:55:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:59 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 Sep 07 13:55:59 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:55:59 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Sep 07 13:55:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933" returned: 0 in 0.596s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:55:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] will copy from snapshot at /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:55:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:55:59 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Path /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c3c3600d-6e58-4324-b39f-263d59ddf31a not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:55:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c3c3600d-6e58-4324-b39f-263d59ddf31a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:55:59 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c3c3600d-6e58-4324-b39f-263d59ddf31a Sep 07 13:55:59 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c3c3600d-6e58-4324-b39f-263d59ddf31a" returned: 0 in 6.085s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:05 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Image conversion details: src /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933, size 1024.00 MB, duration 6.09 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c3c3600d-6e58-4324-b39f-263d59ddf31a {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:56:05 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Converted 1024.00 MB image at 168.25 MB/s Sep 07 13:56:05 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c3c3600d-6e58-4324-b39f-263d59ddf31a is being set with open permissions: ugo+rw Sep 07 13:56:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c3c3600d-6e58-4324-b39f-263d59ddf31a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:05 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c3c3600d-6e58-4324-b39f-263d59ddf31a Sep 07 13:56:05 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:06 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c3c3600d-6e58-4324-b39f-263d59ddf31a" returned: 0 in 0.349s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Lock "cinder-quobyte-c3c3600d-6e58-4324-b39f-263d59ddf31a" released by "_copy_volume_from_snapshot" :: held 7.610s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Acquiring lock "cinder-quobyte-fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Lock "cinder-quobyte-fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Deleting offline snapshot fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 of volume 1b269261-b1fc-4e09-a2d4-ae43bdcec933 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:56:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] snapshot_file for this snap is: volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:56:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d125d57-0ad3-4197-a725-fa6548318cfe]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:06 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 Sep 07 13:56:06 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:06 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9" returned: 0 in 0.574s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:56:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae032673-8337-490e-b746-febae1fe618d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:06 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 Sep 07 13:56:06 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:07 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933" returned: 0 in 0.655s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:07 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 Sep 07 13:56:07 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:07 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=23,cinder:SELECT=17,cinder:INSERT=7 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:56:08 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9" returned: 0 in 0.587s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:08 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9 Sep 07 13:56:08 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:08 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933.fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9" returned: 0 in 0.500s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Lock "cinder-quobyte-fe2e3aa0-0b0f-4aae-9a34-c722ff98f0f9" released by "_delete_snapshot" :: held 2.509s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.225s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdd6030-dd1d-498a-abf9-b117487569b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c3600d-6e58-4324-b39f-263d59ddf31a', 'volume_size': 2, 'source_volid': '1b269261-b1fc-4e09-a2d4-ae43bdcec933', 'source_volstatus': 'available'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77016f9-27bc-48ca-8ba3-79697d49a0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:08 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Volume volume-c3c3600d-6e58-4324-b39f-263d59ddf31a (c3c3600d-6e58-4324-b39f-263d59ddf31a): created successfully Sep 07 13:56:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f77016f9-27bc-48ca-8ba3-79697d49a0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Flow 'volume_create_manager' (81e2d045-20b8-4540-8aa9-46c94870f11e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-01746f8e-ca3a-47e4-bb65-863b51607e1f tempest-VolumesCloneTest-162813763 None] Created volume successfully. Sep 07 13:56:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Acquiring lock "cinder-c3c3600d-6e58-4324-b39f-263d59ddf31a-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Lock "cinder-c3c3600d-6e58-4324-b39f-263d59ddf31a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Acquiring lock "cinder-quobyte-c3c3600d-6e58-4324-b39f-263d59ddf31a" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Lock "cinder-quobyte-c3c3600d-6e58-4324-b39f-263d59ddf31a" acquired by "delete_volume" :: waited 0.037s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:10 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c59e86-5f0a-4e5d-bf57-4e212128fb47]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c3c3600d-6e58-4324-b39f-263d59ddf31a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:10 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c3c3600d-6e58-4324-b39f-263d59ddf31a Sep 07 13:56:10 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:10 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c3c3600d-6e58-4324-b39f-263d59ddf31a" returned: 0 in 0.656s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c3c3600d-6e58-4324-b39f-263d59ddf31a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:10 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c3c3600d-6e58-4324-b39f-263d59ddf31a Sep 07 13:56:10 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:11 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c3c3600d-6e58-4324-b39f-263d59ddf31a" returned: 0 in 0.444s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Lock "cinder-quobyte-c3c3600d-6e58-4324-b39f-263d59ddf31a" released by "delete_volume" :: held 1.193s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:11 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Created reservations ['46cd8911-13fa-46d7-831f-8c50ffede497', '27c85fec-e8a4-40fa-81bb-36d2f20238e5', '93d73f5f-bf10-4b88-844f-b3302411c7c3', '97b13f09-68da-4fc5-a419-01ad39398b03'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:11 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:56:11 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:11 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.329s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:11 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:11 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Deleted volume successfully. Sep 07 13:56:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1d3584cf-f054-42e9-be53-64931fc082ab tempest-VolumesCloneTest-162813763 None] Lock "cinder-c3c3600d-6e58-4324-b39f-263d59ddf31a-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Acquiring lock "cinder-1b269261-b1fc-4e09-a2d4-ae43bdcec933-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Lock "cinder-1b269261-b1fc-4e09-a2d4-ae43bdcec933-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Acquiring lock "cinder-quobyte-1b269261-b1fc-4e09-a2d4-ae43bdcec933" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Lock "cinder-quobyte-1b269261-b1fc-4e09-a2d4-ae43bdcec933" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bed1364-036c-4f7a-a245-5c8d6d2e4e44]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:12 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 Sep 07 13:56:12 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:13 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933" returned: 0 in 0.653s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:13 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933 Sep 07 13:56:13 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:13 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1b269261-b1fc-4e09-a2d4-ae43bdcec933" returned: 0 in 0.450s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Lock "cinder-quobyte-1b269261-b1fc-4e09-a2d4-ae43bdcec933" released by "delete_volume" :: held 1.195s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:13 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Created reservations ['05f869dc-7815-4003-8130-c3648e9e1348', '7ee1e622-3cac-41e4-932f-28560fb833a0', '0f12863b-7743-411e-b4a5-192f6777318b', '889a5c98-007e-4f7b-83fc-faab432f8e9c'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:13 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:56:13 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:14 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.620s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:14 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Deleted volume successfully. Sep 07 13:56:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0c895275-a542-4e21-b03d-1568c12c16bd tempest-VolumesCloneTest-162813763 None] Lock "cinder-1b269261-b1fc-4e09-a2d4-ae43bdcec933-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Flow 'volume_create_manager' (df10f111-e901-4569-aeb5-e44354e93e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2d9712-736f-4a3e-bdc2-f388ded9baef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d2d9712-736f-4a3e-bdc2-f388ded9baef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-727063867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8108833d1e1349c79dc1e6dd045497c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:19Z,use_quota=True,user_id='4ea2323babbc4ceb8a0c1f4379dfc589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa05cea-84de-45db-a3b3-a57a4e626a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fa05cea-84de-45db-a3b3-a57a4e626a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50453fd2-48fc-4b7b-8cce-c3adf2e4e206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50453fd2-48fc-4b7b-8cce-c3adf2e4e206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48', 'volume_name': 'volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07137035-4c86-4b9a-b1c6-323a2b84493f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07137035-4c86-4b9a-b1c6-323a2b84493f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0210722f-0368-4ffa-8c47-fd6c58ff4a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:19 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume 33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48', 'volume_size': 1} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-727063867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8108833d1e1349c79dc1e6dd045497c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:19Z,use_quota=True,user_id='4ea2323babbc4ceb8a0c1f4379dfc589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Creating volume 33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:19 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:19 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 1073741824 Sep 07 13:56:19 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Flow 'volume_create_manager' (3ac1fb34-481e-4195-bc4e-622b99d4418b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d458a1a-219e-4174-b14f-9b2e89d2db9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d458a1a-219e-4174-b14f-9b2e89d2db9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-257815474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631164d8-69fb-452b-86bd-4a67bca04cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b30fcc25d51415083a7976d18ba6936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:20Z,use_quota=True,user_id='ad4f0b1b78b5494f90368694be2ca791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45051f76-be58-4071-9a79-e00a708412dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45051f76-be58-4071-9a79-e00a708412dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa273c80-33e6-4f4a-a9d9-bf9d2ac27628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa273c80-33e6-4f4a-a9d9-bf9d2ac27628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '631164d8-69fb-452b-86bd-4a67bca04cb7', 'volume_name': 'volume-631164d8-69fb-452b-86bd-4a67bca04cb7', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d859c6ee-517c-4318-a38e-8e8b93fb9313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d859c6ee-517c-4318-a38e-8e8b93fb9313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b69436-f63a-4013-aac7-81dbf61645e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:19 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Volume 631164d8-69fb-452b-86bd-4a67bca04cb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-631164d8-69fb-452b-86bd-4a67bca04cb7', 'volume_size': 1} Sep 07 13:56:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:20 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 1073741824" returned: 0 in 0.639s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:20 devstack sudo[100967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 Sep 07 13:56:20 devstack sudo[100967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:20 devstack sudo[100967]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48" returned: 0 in 0.321s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-257815474',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=631164d8-69fb-452b-86bd-4a67bca04cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b30fcc25d51415083a7976d18ba6936',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:20Z,use_quota=True,user_id='ad4f0b1b78b5494f90368694be2ca791',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Creating volume 631164d8-69fb-452b-86bd-4a67bca04cb7 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:20 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-631164d8-69fb-452b-86bd-4a67bca04cb7 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0210722f-0368-4ffa-8c47-fd6c58ff4a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:20 devstack sudo[100970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-631164d8-69fb-452b-86bd-4a67bca04cb7 1073741824 Sep 07 13:56:20 devstack sudo[100970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac82a59-7d6b-47a9-a163-f8ca7bea426d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:20 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 (33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48): created successfully Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ac82a59-7d6b-47a9-a163-f8ca7bea426d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Flow 'volume_create_manager' (df10f111-e901-4569-aeb5-e44354e93e24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d7df91d0-dca5-44d7-91df-3a5cdbc0eee9 tempest-CreateVolumesFromSnapshotTest-190171551 None] Created volume successfully. Sep 07 13:56:21 devstack sudo[100970]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-631164d8-69fb-452b-86bd-4a67bca04cb7 1073741824" returned: 0 in 0.715s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-631164d8-69fb-452b-86bd-4a67bca04cb7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:21 devstack sudo[100976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-631164d8-69fb-452b-86bd-4a67bca04cb7 Sep 07 13:56:21 devstack sudo[100976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:21 devstack sudo[100976]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-631164d8-69fb-452b-86bd-4a67bca04cb7" returned: 0 in 0.371s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2b69436-f63a-4013-aac7-81dbf61645e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-631164d8-69fb-452b-86bd-4a67bca04cb7', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac96b3f7-0f50-4e41-b9b1-3e203c369072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:21 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Volume volume-631164d8-69fb-452b-86bd-4a67bca04cb7 (631164d8-69fb-452b-86bd-4a67bca04cb7): created successfully Sep 07 13:56:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac96b3f7-0f50-4e41-b9b1-3e203c369072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Flow 'volume_create_manager' (3ac1fb34-481e-4195-bc4e-622b99d4418b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b2f390e0-e560-4fe2-9199-e57cf0d5c8ce tempest-TestMinimumBasicScenario-885128730 None] Created volume successfully. Sep 07 13:56:21 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:56:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Flow 'volume_create_manager' (c2e21ef8-108b-498a-95fb-908b3f3e2535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b43b2c3-a73a-4c72-9f9a-37a58f2102be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b43b2c3-a73a-4c72-9f9a-37a58f2102be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1395804586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc7c103-02cf-4e5c-b97c-c72ef45ed851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9629cd4c7e154258a44de436c5c1aa91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:22Z,use_quota=True,user_id='10b2d9958b5847299c4bea5821f75789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7b2238d-5bdc-4dd0-85a9-a77c323b68fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7b2238d-5bdc-4dd0-85a9-a77c323b68fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f95f5b5-335f-4ff2-8521-85ac26b6d99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f95f5b5-335f-4ff2-8521-85ac26b6d99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fc7c103-02cf-4e5c-b97c-c72ef45ed851', 'volume_name': 'volume-8fc7c103-02cf-4e5c-b97c-c72ef45ed851', 'volume_size': 2}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ba723f-ef03-4dfc-bb3c-e95c5fe6bf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09ba723f-ef03-4dfc-bb3c-e95c5fe6bf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f11f12-18e3-4236-838d-0af36798c6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:22 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Volume 8fc7c103-02cf-4e5c-b97c-c72ef45ed851: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fc7c103-02cf-4e5c-b97c-c72ef45ed851', 'volume_size': 2} Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Creating offline snapshot b4f70689-745f-4d46-9ca2-195b379510c0 of volume 33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cd1eba-2497-4904-a52f-504dc3856c71]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:22 devstack sudo[100980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 Sep 07 13:56:22 devstack sudo[100980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:22 devstack sudo[100980]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48" returned: 0 in 0.445s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:22 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0 1G Sep 07 13:56:22 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:23 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0 1G" returned: 0 in 0.623s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:23 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0 Sep 07 13:56:23 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:23 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0" returned: 0 in 0.374s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:23 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0 is being set with open permissions: ugo+rw Sep 07 13:56:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:23 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0 Sep 07 13:56:23 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:23 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0" returned: 0 in 0.380s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:24 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.info Sep 07 13:56:24 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-efe09f24-7df0-4b31-a468-90fc4fc20db0 req-7f78d87b-b96a-461d-baa9-ea3a2a2a55bb tempest-TestMinimumBasicScenario-885128730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:24 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.info" returned: 0 in 0.346s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:24 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.info is being set with open permissions: ugo+rw Sep 07 13:56:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:24 devstack sudo[101015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.info Sep 07 13:56:24 devstack sudo[101015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:24 devstack sudo[101015]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.info" returned: 0 in 0.294s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.636s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.595s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1395804586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc7c103-02cf-4e5c-b97c-c72ef45ed851,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9629cd4c7e154258a44de436c5c1aa91',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:22Z,use_quota=True,user_id='10b2d9958b5847299c4bea5821f75789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Creating volume 8fc7c103-02cf-4e5c-b97c-c72ef45ed851 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:24 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:56:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8fc7c103-02cf-4e5c-b97c-c72ef45ed851 2147483648 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:24 devstack sudo[101018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8fc7c103-02cf-4e5c-b97c-c72ef45ed851 2147483648 Sep 07 13:56:24 devstack sudo[101018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9f3c7246-6f38-4a97-8386-c3afdf8d2e30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Create snapshot completed successfully Sep 07 13:56:25 devstack sudo[101018]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8fc7c103-02cf-4e5c-b97c-c72ef45ed851 2147483648" returned: 0 in 0.694s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8fc7c103-02cf-4e5c-b97c-c72ef45ed851 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:25 devstack sudo[101024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8fc7c103-02cf-4e5c-b97c-c72ef45ed851 Sep 07 13:56:25 devstack sudo[101024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:56:25 devstack sudo[101024]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Flow 'volume_create_manager' (7305db71-15be-4e28-bdba-bb6462944326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98bcbff7-0971-4f9d-bac4-3bb6215e3c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8fc7c103-02cf-4e5c-b97c-c72ef45ed851" returned: 0 in 0.462s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.229s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-efe09f24-7df0-4b31-a468-90fc4fc20db0 req-7f78d87b-b96a-461d-baa9-ea3a2a2a55bb tempest-TestMinimumBasicScenario-885128730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.718s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98bcbff7-0971-4f9d-bac4-3bb6215e3c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1735085251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93747681-85ac-4552-a0ff-1d644f69c1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8108833d1e1349c79dc1e6dd045497c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:26Z,use_quota=True,user_id='4ea2323babbc4ceb8a0c1f4379dfc589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a8052d-fc5a-46bc-bf21-dfbfe1009624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5a8052d-fc5a-46bc-bf21-dfbfe1009624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eda9e8e-c9c7-4eec-a8cc-c8fda89499a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8eda9e8e-c9c7-4eec-a8cc-c8fda89499a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93747681-85ac-4552-a0ff-1d644f69c1c2', 'volume_name': 'volume-93747681-85ac-4552-a0ff-1d644f69c1c2', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2460968-5eba-4678-a9db-0513d52c880e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2460968-5eba-4678-a9db-0513d52c880e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3bdec5-8a1a-4e84-b740-cf3eb13cf5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:25 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume 93747681-85ac-4552-a0ff-1d644f69c1c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93747681-85ac-4552-a0ff-1d644f69c1c2', 'volume_size': 1} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f11f12-18e3-4236-838d-0af36798c6e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fc7c103-02cf-4e5c-b97c-c72ef45ed851', 'volume_size': 2}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08edc05e-3d32-4e72-a8ea-44666eb76e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-efe09f24-7df0-4b31-a468-90fc4fc20db0 req-7f78d87b-b96a-461d-baa9-ea3a2a2a55bb tempest-TestMinimumBasicScenario-885128730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.112s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.026s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1735085251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93747681-85ac-4552-a0ff-1d644f69c1c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8108833d1e1349c79dc1e6dd045497c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:26Z,use_quota=True,user_id='4ea2323babbc4ceb8a0c1f4379dfc589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Creating volume 93747681-85ac-4552-a0ff-1d644f69c1c2 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:26 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-93747681-85ac-4552-a0ff-1d644f69c1c2 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:26 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Volume volume-8fc7c103-02cf-4e5c-b97c-c72ef45ed851 (8fc7c103-02cf-4e5c-b97c-c72ef45ed851): created successfully Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08edc05e-3d32-4e72-a8ea-44666eb76e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:26 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-93747681-85ac-4552-a0ff-1d644f69c1c2 1073741824 Sep 07 13:56:26 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Flow 'volume_create_manager' (c2e21ef8-108b-498a-95fb-908b3f3e2535) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-bda9f2c4-c3d7-4a27-bcc9-028694166b2c tempest-VolumesCloneNegativeTest-1618998868 None] Created volume successfully. Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-efe09f24-7df0-4b31-a468-90fc4fc20db0 req-7f78d87b-b96a-461d-baa9-ea3a2a2a55bb tempest-TestMinimumBasicScenario-885128730 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-631164d8-69fb-452b-86bd-4a67bca04cb7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23ba21ef-1297-4394-b515-b002ebdcc83a', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Flow 'volume_create_manager' (3f03ada9-5d8c-4a37-a6aa-6f894fd7e9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d882b49c-1b81-4afa-a56e-153718d2499d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d882b49c-1b81-4afa-a56e-153718d2499d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-861151022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee93ccb-3377-4dcc-a836-bcc127788270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8108833d1e1349c79dc1e6dd045497c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:26Z,use_quota=True,user_id='4ea2323babbc4ceb8a0c1f4379dfc589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f425cee-1e56-4ec0-a46a-273045b24269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f425cee-1e56-4ec0-a46a-273045b24269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc63790-0963-4370-81ad-e21e00ad9a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecc63790-0963-4370-81ad-e21e00ad9a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ee93ccb-3377-4dcc-a836-bcc127788270', 'volume_name': 'volume-3ee93ccb-3377-4dcc-a836-bcc127788270', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb2665a-106c-4f7e-9bbd-769df5cab21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fb2665a-106c-4f7e-9bbd-769df5cab21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fc90ea-9f1b-4164-9247-8094fdd62dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:26 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume 3ee93ccb-3377-4dcc-a836-bcc127788270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ee93ccb-3377-4dcc-a836-bcc127788270', 'volume_size': 1} Sep 07 13:56:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-efe09f24-7df0-4b31-a468-90fc4fc20db0 req-7f78d87b-b96a-461d-baa9-ea3a2a2a55bb tempest-TestMinimumBasicScenario-885128730 None] attachment_update completed successfully. Sep 07 13:56:27 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-93747681-85ac-4552-a0ff-1d644f69c1c2 1073741824" returned: 0 in 1.058s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Flow 'volume_create_manager' (461f4831-359b-45d6-a03f-5a8da4567e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8136e3f1-ffd7-4625-934f-125150845bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8136e3f1-ffd7-4625-934f-125150845bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-696841065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83934a85-8c3b-4214-9faf-44623e7f9a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8108833d1e1349c79dc1e6dd045497c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:27Z,use_quota=True,user_id='4ea2323babbc4ceb8a0c1f4379dfc589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc66498-c54c-4bab-8333-223e04f2b5a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cc66498-c54c-4bab-8333-223e04f2b5a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae18fce-b212-481b-815a-9c9261f1350f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ae18fce-b212-481b-815a-9c9261f1350f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83934a85-8c3b-4214-9faf-44623e7f9a6c', 'volume_name': 'volume-83934a85-8c3b-4214-9faf-44623e7f9a6c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67124a92-aac3-4a5a-a891-633a2b2055d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67124a92-aac3-4a5a-a891-633a2b2055d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6806c694-12d9-470f-90f3-5f5fae3a9658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:27 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume 83934a85-8c3b-4214-9faf-44623e7f9a6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83934a85-8c3b-4214-9faf-44623e7f9a6c', 'volume_size': 1} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-93747681-85ac-4552-a0ff-1d644f69c1c2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:27 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-93747681-85ac-4552-a0ff-1d644f69c1c2 Sep 07 13:56:27 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Acquiring lock "cinder-8fc7c103-02cf-4e5c-b97c-c72ef45ed851-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Lock "cinder-8fc7c103-02cf-4e5c-b97c-c72ef45ed851-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Acquiring lock "cinder-quobyte-8fc7c103-02cf-4e5c-b97c-c72ef45ed851" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Lock "cinder-quobyte-8fc7c103-02cf-4e5c-b97c-c72ef45ed851" acquired by "delete_volume" :: waited 0.044s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ac029f-ba38-4ed9-aa80-49618527a9ec]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8fc7c103-02cf-4e5c-b97c-c72ef45ed851 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:27 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-93747681-85ac-4552-a0ff-1d644f69c1c2" returned: 0 in 0.481s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.325s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-861151022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ee93ccb-3377-4dcc-a836-bcc127788270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8108833d1e1349c79dc1e6dd045497c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:26Z,use_quota=True,user_id='4ea2323babbc4ceb8a0c1f4379dfc589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Creating volume 3ee93ccb-3377-4dcc-a836-bcc127788270 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:27 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ee93ccb-3377-4dcc-a836-bcc127788270 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd3bdec5-8a1a-4e84-b740-cf3eb13cf5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93747681-85ac-4552-a0ff-1d644f69c1c2', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b80b7c83-e45d-4954-beee-b10b40a86631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:27 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume volume-93747681-85ac-4552-a0ff-1d644f69c1c2 (93747681-85ac-4552-a0ff-1d644f69c1c2): created successfully Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b80b7c83-e45d-4954-beee-b10b40a86631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:27 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ee93ccb-3377-4dcc-a836-bcc127788270 1073741824 Sep 07 13:56:27 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Flow 'volume_create_manager' (7305db71-15be-4e28-bdba-bb6462944326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:27 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5d92fdf4-d2f3-4031-9b96-c37f248c3cb4 tempest-CreateVolumesFromSnapshotTest-190171551 None] Created volume successfully. Sep 07 13:56:27 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8fc7c103-02cf-4e5c-b97c-c72ef45ed851 Sep 07 13:56:27 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:28 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:56:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Flow 'volume_create_manager' (f835a5bc-9a76-44ba-afbe-b0e9b963d221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd54816-30c8-41eb-b568-de4a4e1d8499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3cd54816-30c8-41eb-b568-de4a4e1d8499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-221869444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678ee4ba-b560-45be-b278-5dc3210256b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8108833d1e1349c79dc1e6dd045497c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:28Z,use_quota=True,user_id='4ea2323babbc4ceb8a0c1f4379dfc589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4e80f2-4542-4196-8088-f784b6c047fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a4e80f2-4542-4196-8088-f784b6c047fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421b1006-fb84-4786-b11c-1f3cff20e626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (421b1006-fb84-4786-b11c-1f3cff20e626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '678ee4ba-b560-45be-b278-5dc3210256b5', 'volume_name': 'volume-678ee4ba-b560-45be-b278-5dc3210256b5', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9eebc09-182c-4b56-bc5a-5ac5602b1506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9eebc09-182c-4b56-bc5a-5ac5602b1506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99fcebe0-3822-45ad-bd68-e478eeec2712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:28 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume 678ee4ba-b560-45be-b278-5dc3210256b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-678ee4ba-b560-45be-b278-5dc3210256b5', 'volume_size': 1} Sep 07 13:56:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8fc7c103-02cf-4e5c-b97c-c72ef45ed851" returned: 0 in 0.765s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8fc7c103-02cf-4e5c-b97c-c72ef45ed851 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:28 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:28 devstack sudo[101443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8fc7c103-02cf-4e5c-b97c-c72ef45ed851 Sep 07 13:56:28 devstack sudo[101443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:28 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ee93ccb-3377-4dcc-a836-bcc127788270 1073741824" returned: 0 in 0.936s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ee93ccb-3377-4dcc-a836-bcc127788270 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:28 devstack sudo[101468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ee93ccb-3377-4dcc-a836-bcc127788270 Sep 07 13:56:28 devstack sudo[101468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:29 devstack sudo[101443]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8fc7c103-02cf-4e5c-b97c-c72ef45ed851" returned: 0 in 0.607s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Lock "cinder-quobyte-8fc7c103-02cf-4e5c-b97c-c72ef45ed851" released by "delete_volume" :: held 1.473s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Created reservations ['e5902a6f-c74e-4281-a90a-c0f08226c4bc', 'f5f761b8-1141-478f-988d-a0bb69221f36', '2d86f610-6c22-4149-b75c-d688ab06f8cd', '5a51ccd4-4a2c-482b-bcb7-2b22fa611da3'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Flow 'volume_create_manager' (7f58a9a9-c0c2-4400-aa99-4dc0f5575234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d52993-d03d-4cef-8023-003aa0e6c710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:29 devstack sudo[101468]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7d52993-d03d-4cef-8023-003aa0e6c710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1061418682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e154bcb5-450a-4550-a1bc-a4006556b172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8108833d1e1349c79dc1e6dd045497c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:29Z,use_quota=True,user_id='4ea2323babbc4ceb8a0c1f4379dfc589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f4f767-7d1e-4d8f-afcb-661162d3c527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29f4f767-7d1e-4d8f-afcb-661162d3c527) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31e8ade-dd5e-466c-8e1a-a5804e35b763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31e8ade-dd5e-466c-8e1a-a5804e35b763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e154bcb5-450a-4550-a1bc-a4006556b172', 'volume_name': 'volume-e154bcb5-450a-4550-a1bc-a4006556b172', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6841a3-cff3-46b3-bf15-348ff686da19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af6841a3-cff3-46b3-bf15-348ff686da19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485cbc8d-5b3d-47a6-95a6-f15136138aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:29 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume e154bcb5-450a-4550-a1bc-a4006556b172: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e154bcb5-450a-4550-a1bc-a4006556b172', 'volume_size': 1} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ee93ccb-3377-4dcc-a836-bcc127788270" returned: 0 in 0.570s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] <== create_volume: return (1632ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.169s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-696841065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83934a85-8c3b-4214-9faf-44623e7f9a6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8108833d1e1349c79dc1e6dd045497c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:27Z,use_quota=True,user_id='4ea2323babbc4ceb8a0c1f4379dfc589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Creating volume 83934a85-8c3b-4214-9faf-44623e7f9a6c {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:29 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-83934a85-8c3b-4214-9faf-44623e7f9a6c 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1fc90ea-9f1b-4164-9247-8094fdd62dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ee93ccb-3377-4dcc-a836-bcc127788270', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae7202d-cab0-4487-bc6a-fae64a14f37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:29 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-83934a85-8c3b-4214-9faf-44623e7f9a6c 1073741824 Sep 07 13:56:29 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:29 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume volume-3ee93ccb-3377-4dcc-a836-bcc127788270 (3ee93ccb-3377-4dcc-a836-bcc127788270): created successfully Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ae7202d-cab0-4487-bc6a-fae64a14f37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Flow 'volume_create_manager' (3f03ada9-5d8c-4a37-a6aa-6f894fd7e9c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ab2190cc-0b54-471e-9f0e-7a2531c276c8 tempest-CreateVolumesFromSnapshotTest-190171551 None] Created volume successfully. Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:29 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:56:29 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:29 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:56:29 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:29 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.339s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Deleted volume successfully. Sep 07 13:56:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6ad97853-38c8-411a-b1b0-f2beec846e7b tempest-VolumesCloneNegativeTest-1618998868 None] Lock "cinder-8fc7c103-02cf-4e5c-b97c-c72ef45ed851-delete_volume" released by "delete_volume" :: held 2.485s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:30 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-83934a85-8c3b-4214-9faf-44623e7f9a6c 1073741824" returned: 0 in 0.681s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-83934a85-8c3b-4214-9faf-44623e7f9a6c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:30 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.456s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:30 devstack sudo[101484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-83934a85-8c3b-4214-9faf-44623e7f9a6c Sep 07 13:56:30 devstack sudo[101484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 29 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:56:30 devstack sudo[101484]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-83934a85-8c3b-4214-9faf-44623e7f9a6c" returned: 0 in 0.336s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.199s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-221869444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=678ee4ba-b560-45be-b278-5dc3210256b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8108833d1e1349c79dc1e6dd045497c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:28Z,use_quota=True,user_id='4ea2323babbc4ceb8a0c1f4379dfc589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Creating volume 678ee4ba-b560-45be-b278-5dc3210256b5 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:30 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-678ee4ba-b560-45be-b278-5dc3210256b5 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:30 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-678ee4ba-b560-45be-b278-5dc3210256b5 1073741824 Sep 07 13:56:30 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6806c694-12d9-470f-90f3-5f5fae3a9658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83934a85-8c3b-4214-9faf-44623e7f9a6c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41b5879-5258-4fa2-ae83-1c1fe94c65fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:30 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume volume-83934a85-8c3b-4214-9faf-44623e7f9a6c (83934a85-8c3b-4214-9faf-44623e7f9a6c): created successfully Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41b5879-5258-4fa2-ae83-1c1fe94c65fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Flow 'volume_create_manager' (461f4831-359b-45d6-a03f-5a8da4567e57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:30 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7beb9067-c1d9-40c8-a500-e09cf311f8ae tempest-CreateVolumesFromSnapshotTest-190171551 None] Created volume successfully. Sep 07 13:56:31 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-678ee4ba-b560-45be-b278-5dc3210256b5 1073741824" returned: 0 in 0.633s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-678ee4ba-b560-45be-b278-5dc3210256b5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:31 devstack sudo[101494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-678ee4ba-b560-45be-b278-5dc3210256b5 Sep 07 13:56:31 devstack sudo[101494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:31 devstack sudo[101494]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-678ee4ba-b560-45be-b278-5dc3210256b5" returned: 0 in 0.291s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.111s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1061418682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e154bcb5-450a-4550-a1bc-a4006556b172,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8108833d1e1349c79dc1e6dd045497c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:56:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:56:29Z,use_quota=True,user_id='4ea2323babbc4ceb8a0c1f4379dfc589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Creating volume e154bcb5-450a-4550-a1bc-a4006556b172 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:31 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e154bcb5-450a-4550-a1bc-a4006556b172 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:31 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e154bcb5-450a-4550-a1bc-a4006556b172 1073741824 Sep 07 13:56:31 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99fcebe0-3822-45ad-bd68-e478eeec2712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-678ee4ba-b560-45be-b278-5dc3210256b5', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e279e2e-02ae-4600-ba21-8ea72d621d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:31 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume volume-678ee4ba-b560-45be-b278-5dc3210256b5 (678ee4ba-b560-45be-b278-5dc3210256b5): created successfully Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e279e2e-02ae-4600-ba21-8ea72d621d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Flow 'volume_create_manager' (f835a5bc-9a76-44ba-afbe-b0e9b963d221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b2d3315a-a539-4558-9501-daf4062854fc tempest-CreateVolumesFromSnapshotTest-190171551 None] Created volume successfully. Sep 07 13:56:32 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e154bcb5-450a-4550-a1bc-a4006556b172 1073741824" returned: 0 in 0.583s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e154bcb5-450a-4550-a1bc-a4006556b172 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:32 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e154bcb5-450a-4550-a1bc-a4006556b172 Sep 07 13:56:32 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:32 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e154bcb5-450a-4550-a1bc-a4006556b172" returned: 0 in 0.302s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:56:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485cbc8d-5b3d-47a6-95a6-f15136138aad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e154bcb5-450a-4550-a1bc-a4006556b172', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a70002-27d5-43d7-96bf-c329bf60ceb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:32 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Volume volume-e154bcb5-450a-4550-a1bc-a4006556b172 (e154bcb5-450a-4550-a1bc-a4006556b172): created successfully Sep 07 13:56:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67a70002-27d5-43d7-96bf-c329bf60ceb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Flow 'volume_create_manager' (7f58a9a9-c0c2-4400-aa99-4dc0f5575234) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:32 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-82e4c9d9-886e-4f03-8d58-21baf75b051a tempest-CreateVolumesFromSnapshotTest-190171551 None] Created volume successfully. Sep 07 13:56:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "cinder-e154bcb5-450a-4550-a1bc-a4006556b172-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-e154bcb5-450a-4550-a1bc-a4006556b172-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "cinder-quobyte-e154bcb5-450a-4550-a1bc-a4006556b172" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-quobyte-e154bcb5-450a-4550-a1bc-a4006556b172" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:34 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[53621c76-afc8-4291-9a5c-0b67c62a2439]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e154bcb5-450a-4550-a1bc-a4006556b172 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:34 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e154bcb5-450a-4550-a1bc-a4006556b172 Sep 07 13:56:34 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:34 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e154bcb5-450a-4550-a1bc-a4006556b172" returned: 0 in 0.592s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e154bcb5-450a-4550-a1bc-a4006556b172 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:34 devstack sudo[101514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e154bcb5-450a-4550-a1bc-a4006556b172 Sep 07 13:56:34 devstack sudo[101514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:34 devstack sudo[101514]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e154bcb5-450a-4550-a1bc-a4006556b172" returned: 0 in 0.317s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-quobyte-e154bcb5-450a-4550-a1bc-a4006556b172" released by "delete_volume" :: held 0.973s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:35 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Created reservations ['e376739f-54bc-48a0-b8df-1ba8d3ebb1ea', '4ecc7ad8-424f-4e0c-b4fe-624a0adc99db', '97e9a77f-2cd3-4c0a-92df-de24aac86863', '68927617-95c0-4929-9efc-3909f42d6dc0'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:35 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:56:35 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:35 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.280s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:35 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:35 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Deleted volume successfully. Sep 07 13:56:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd5ac086-9e72-493d-817d-ad7ae26ece30 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-e154bcb5-450a-4550-a1bc-a4006556b172-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "cinder-678ee4ba-b560-45be-b278-5dc3210256b5-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-678ee4ba-b560-45be-b278-5dc3210256b5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "cinder-quobyte-678ee4ba-b560-45be-b278-5dc3210256b5" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-quobyte-678ee4ba-b560-45be-b278-5dc3210256b5" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:36 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[13784d75-1ea1-4960-a23b-7ac3adc9781d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-678ee4ba-b560-45be-b278-5dc3210256b5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:36 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-678ee4ba-b560-45be-b278-5dc3210256b5 Sep 07 13:56:36 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:36 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-678ee4ba-b560-45be-b278-5dc3210256b5" returned: 0 in 0.459s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-678ee4ba-b560-45be-b278-5dc3210256b5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:36 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-678ee4ba-b560-45be-b278-5dc3210256b5 Sep 07 13:56:36 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:37 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-678ee4ba-b560-45be-b278-5dc3210256b5" returned: 0 in 0.301s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-quobyte-678ee4ba-b560-45be-b278-5dc3210256b5" released by "delete_volume" :: held 0.824s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Created reservations ['aed7a55f-3cec-4789-8d80-882f5911357d', '3090a621-b32f-4a6b-abca-9b7e04e37c5d', '40e26a34-f0a3-4175-880c-ec287ca54cba', 'db45c18e-4607-4e6b-9508-15232acb4f86'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:37 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:56:37 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "cinder-83934a85-8c3b-4214-9faf-44623e7f9a6c-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-83934a85-8c3b-4214-9faf-44623e7f9a6c-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "cinder-quobyte-83934a85-8c3b-4214-9faf-44623e7f9a6c" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-quobyte-83934a85-8c3b-4214-9faf-44623e7f9a6c" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[106fa05a-e969-4e15-84ba-a89a6630cb41]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-83934a85-8c3b-4214-9faf-44623e7f9a6c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:37 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.492s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Deleted volume successfully. Sep 07 13:56:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fcdca57-e96b-4303-b2f5-ec1780a26b15 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-678ee4ba-b560-45be-b278-5dc3210256b5-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:37 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-83934a85-8c3b-4214-9faf-44623e7f9a6c Sep 07 13:56:37 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:38 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-83934a85-8c3b-4214-9faf-44623e7f9a6c" returned: 0 in 0.513s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-83934a85-8c3b-4214-9faf-44623e7f9a6c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:38 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-83934a85-8c3b-4214-9faf-44623e7f9a6c Sep 07 13:56:38 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:38 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-83934a85-8c3b-4214-9faf-44623e7f9a6c" returned: 0 in 0.323s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-quobyte-83934a85-8c3b-4214-9faf-44623e7f9a6c" released by "delete_volume" :: held 0.894s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Created reservations ['01ca1db4-b2de-4e24-a8d5-3df9bcf0c77c', '6a6c3541-ba2a-4b75-9bcc-343a947d243a', '985e114b-e268-48af-9752-cef1c1ee86af', '305e5ca5-87bd-4d8f-bbde-6072f5f41318'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:38 devstack sudo[101540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:56:38 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "cinder-3ee93ccb-3377-4dcc-a836-bcc127788270-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-3ee93ccb-3377-4dcc-a836-bcc127788270-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "cinder-quobyte-3ee93ccb-3377-4dcc-a836-bcc127788270" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-quobyte-3ee93ccb-3377-4dcc-a836-bcc127788270" acquired by "delete_volume" :: waited 0.038s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e4124a-b591-4932-9410-f1e061559128]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ee93ccb-3377-4dcc-a836-bcc127788270 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:39 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.403s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:39 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:39 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Deleted volume successfully. Sep 07 13:56:39 devstack sudo[101542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ee93ccb-3377-4dcc-a836-bcc127788270 Sep 07 13:56:39 devstack sudo[101542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-010893bf-6402-4dec-89c2-395a9762f1e5 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-83934a85-8c3b-4214-9faf-44623e7f9a6c-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:39 devstack sudo[101542]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ee93ccb-3377-4dcc-a836-bcc127788270" returned: 0 in 0.581s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ee93ccb-3377-4dcc-a836-bcc127788270 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:39 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ee93ccb-3377-4dcc-a836-bcc127788270 Sep 07 13:56:39 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:39 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3ee93ccb-3377-4dcc-a836-bcc127788270" returned: 0 in 0.315s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-quobyte-3ee93ccb-3377-4dcc-a836-bcc127788270" released by "delete_volume" :: held 0.975s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:39 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Created reservations ['ab62d227-e97d-430f-b26e-f1a70010d814', '2e2c2250-5ae5-4b51-9736-0f8b49512b8d', '863fe9ac-1c95-4aa7-8a2e-6349ce444e84', '18175285-cd54-473d-9e11-0bbcf3150639'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:40 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:56:40 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:40 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.335s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:40 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:40 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Deleted volume successfully. Sep 07 13:56:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-73445fdd-7366-4f51-9e1f-b03ff182e6fe tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-3ee93ccb-3377-4dcc-a836-bcc127788270-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "cinder-93747681-85ac-4552-a0ff-1d644f69c1c2-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-93747681-85ac-4552-a0ff-1d644f69c1c2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "cinder-quobyte-93747681-85ac-4552-a0ff-1d644f69c1c2" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-quobyte-93747681-85ac-4552-a0ff-1d644f69c1c2" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:41 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c94e9f-f94e-46e7-b7cb-1bf38d0e6bf5]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-93747681-85ac-4552-a0ff-1d644f69c1c2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:41 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-93747681-85ac-4552-a0ff-1d644f69c1c2 Sep 07 13:56:41 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:41 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-93747681-85ac-4552-a0ff-1d644f69c1c2" returned: 0 in 0.531s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-93747681-85ac-4552-a0ff-1d644f69c1c2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:41 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-93747681-85ac-4552-a0ff-1d644f69c1c2 Sep 07 13:56:41 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:42 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-93747681-85ac-4552-a0ff-1d644f69c1c2" returned: 0 in 0.327s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-quobyte-93747681-85ac-4552-a0ff-1d644f69c1c2" released by "delete_volume" :: held 0.918s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Created reservations ['c6912acb-1cd4-48ce-8c53-f9da0a9f904f', 'f44cf10a-18a2-487f-9f92-72fe826b1a91', '53b1299c-9ce3-4d69-a49a-65a3a237023f', 'aef30eb8-e8e5-42ba-9c12-b171d200ee2e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:42 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:56:42 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "cinder-b4f70689-745f-4d46-9ca2-195b379510c0-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-b4f70689-745f-4d46-9ca2-195b379510c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "cinder-quobyte-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-quobyte-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "cinder-quobyte-b4f70689-745f-4d46-9ca2-195b379510c0" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-quobyte-b4f70689-745f-4d46-9ca2-195b379510c0" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Deleting offline snapshot b4f70689-745f-4d46-9ca2-195b379510c0 of volume 33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] snapshot_file for this snap is: volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5a3fd7-db84-4380-ab77-9965f289ee64]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:42 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0 Sep 07 13:56:42 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:42 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.361s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Deleted volume successfully. Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c5f09bda-405f-4c0d-8763-3d95ef646fa0 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-93747681-85ac-4552-a0ff-1d644f69c1c2-delete_volume" released by "delete_volume" :: held 1.549s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:42 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0" returned: 0 in 0.446s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:56:43 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c3b51c-3f30-485b-aef4-e0fb88ab0851]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:43 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 Sep 07 13:56:43 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:43 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48" returned: 0 in 0.516s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:43 devstack sudo[101579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0 Sep 07 13:56:43 devstack sudo[101579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:43 devstack sudo[101579]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0" returned: 0 in 0.439s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:44 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0 Sep 07 13:56:44 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:44 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48.b4f70689-745f-4d46-9ca2-195b379510c0" returned: 0 in 0.321s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-quobyte-b4f70689-745f-4d46-9ca2-195b379510c0" released by "_delete_snapshot" :: held 1.863s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-quobyte-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48" released by "delete_snapshot" :: held 1.895s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:44 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Created reservations ['ee907790-0188-40c5-ae31-1f681cecc5dd', '3c9e4614-341a-4ee0-9f13-01069b857fc3', '872f009f-b1c8-4752-9adb-3b7665fb78e8', 'a60682de-90ab-4ee6-aa5d-4b7edee5de3c'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Delete snapshot completed successfully. Sep 07 13:56:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c996dc8-465e-4d1c-8a74-3abe426f5ed3 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-b4f70689-745f-4d46-9ca2-195b379510c0-delete_snapshot" released by "delete_snapshot" :: held 2.094s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "cinder-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "cinder-quobyte-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:56:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-quobyte-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48" acquired by "delete_volume" :: waited 0.038s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:56:44 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[090e324e-7cc9-4efb-8fed-9d5bd0f45a3a]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:56:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:45 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 Sep 07 13:56:45 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:45 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48" returned: 0 in 0.635s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:45 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48 Sep 07 13:56:45 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:45 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48" returned: 0 in 0.409s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-quobyte-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48" released by "delete_volume" :: held 1.173s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:46 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Created reservations ['0c1a10cd-952e-495c-b67f-314bea5a8e75', '9c9833ac-46ee-441b-a198-2fbba0503183', 'bd8d4503-da8e-4d45-80c4-614df93ae658', '8ecbb271-4375-45ca-8189-deedaa060223'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:56:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:56:46 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:56:46 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:56:46 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Sep 07 13:56:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.363s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:56:46 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:56:46 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Deleted volume successfully. Sep 07 13:56:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-14bdd258-7c88-448c-911e-5c561d65da74 tempest-CreateVolumesFromSnapshotTest-190171551 None] Lock "cinder-33c8e12e-82ce-4ac2-a94c-dd4bcecb3e48-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:56:52 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=94,cinder:UPDATE=134,cinder:DELETE=14,cinder:INSERT=29 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Flow 'volume_create_manager' (4e18ab41-cb48-472a-95f7-3bf50e9367e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb3760e-4900-4855-ae98-c217e0613ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bb3760e-4900-4855-ae98-c217e0613ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1808616894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c848b0-5ae9-47c9-bbfe-d6c066855406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07b75e76b284cc497a32053c1b98305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:00Z,use_quota=True,user_id='4fa5c97df3204986b149ff0072e6387e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937601d2-0e01-4c38-a7b0-cb90dd985d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (937601d2-0e01-4c38-a7b0-cb90dd985d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e98b62-20d4-4942-9dba-3c4a8de9198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e98b62-20d4-4942-9dba-3c4a8de9198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4c848b0-5ae9-47c9-bbfe-d6c066855406', 'volume_name': 'volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6031e1f8-fb86-4bb0-a096-76cdf886c96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6031e1f8-fb86-4bb0-a096-76cdf886c96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4743e15a-a76f-40f8-9c5c-7eaf8fb6d3ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:56:59 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Volume f4c848b0-5ae9-47c9-bbfe-d6c066855406: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406', 'volume_size': 1} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1808616894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4c848b0-5ae9-47c9-bbfe-d6c066855406,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07b75e76b284cc497a32053c1b98305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:00Z,use_quota=True,user_id='4fa5c97df3204986b149ff0072e6387e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Creating volume f4c848b0-5ae9-47c9-bbfe-d6c066855406 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:56:59 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:56:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:00 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406 1073741824 Sep 07 13:57:00 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:00 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:57:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Flow 'volume_create_manager' (3e16573c-a6db-4e03-a47b-86c1728ec43f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22122ac8-16b0-41f9-a213-052802a444a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22122ac8-16b0-41f9-a213-052802a444a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-114121747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993d7366-900e-42bf-a97c-f5e4503cb162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07b75e76b284cc497a32053c1b98305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:00Z,use_quota=True,user_id='4fa5c97df3204986b149ff0072e6387e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6d8423-d06b-492b-bc7f-b10359da880e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6d8423-d06b-492b-bc7f-b10359da880e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18126cad-5e1b-461d-812c-d2842316258d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18126cad-5e1b-461d-812c-d2842316258d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '993d7366-900e-42bf-a97c-f5e4503cb162', 'volume_name': 'volume-993d7366-900e-42bf-a97c-f5e4503cb162', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c97b08-465a-40e7-9e42-fbb1676b502d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c97b08-465a-40e7-9e42-fbb1676b502d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04ed30d-ffcc-445b-9a90-6285e8c2f44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:00 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Volume 993d7366-900e-42bf-a97c-f5e4503cb162: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-993d7366-900e-42bf-a97c-f5e4503cb162', 'volume_size': 1} Sep 07 13:57:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:00 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406 1073741824" returned: 0 in 0.731s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:00 devstack sudo[101676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406 Sep 07 13:57:00 devstack sudo[101676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:01 devstack sudo[101676]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406" returned: 0 in 0.319s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.453s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-114121747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993d7366-900e-42bf-a97c-f5e4503cb162,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d07b75e76b284cc497a32053c1b98305',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:00Z,use_quota=True,user_id='4fa5c97df3204986b149ff0072e6387e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Creating volume 993d7366-900e-42bf-a97c-f5e4503cb162 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:57:01 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-993d7366-900e-42bf-a97c-f5e4503cb162 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4743e15a-a76f-40f8-9c5c-7eaf8fb6d3ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:01 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-993d7366-900e-42bf-a97c-f5e4503cb162 1073741824 Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79545be2-d3b2-466d-b0cd-d7e885290922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:01 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:01 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Volume volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406 (f4c848b0-5ae9-47c9-bbfe-d6c066855406): created successfully Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79545be2-d3b2-466d-b0cd-d7e885290922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Flow 'volume_create_manager' (4e18ab41-cb48-472a-95f7-3bf50e9367e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-275bd201-61ad-4c23-be6d-605a9171efd2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Created volume successfully. Sep 07 13:57:01 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-993d7366-900e-42bf-a97c-f5e4503cb162 1073741824" returned: 0 in 0.654s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-993d7366-900e-42bf-a97c-f5e4503cb162 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:01 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-993d7366-900e-42bf-a97c-f5e4503cb162 Sep 07 13:57:01 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:02 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-993d7366-900e-42bf-a97c-f5e4503cb162" returned: 0 in 0.326s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] <== create_volume: return (1038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:57:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.041s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04ed30d-ffcc-445b-9a90-6285e8c2f44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993d7366-900e-42bf-a97c-f5e4503cb162', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b63c5d9-ba0b-4f48-baec-553c3f466a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:02 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Volume volume-993d7366-900e-42bf-a97c-f5e4503cb162 (993d7366-900e-42bf-a97c-f5e4503cb162): created successfully Sep 07 13:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b63c5d9-ba0b-4f48-baec-553c3f466a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Flow 'volume_create_manager' (3e16573c-a6db-4e03-a47b-86c1728ec43f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:02 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d7d830f6-6e1f-4c72-8c7b-4b5ac6a85be5 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Created volume successfully. Sep 07 13:57:12 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=112,cinder:SELECT=83,cinder:DELETE=9,cinder:INSERT=28 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:57:12 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=5,cinder:SELECT=3,cinder:DELETE=2 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Flow 'volume_create_manager' (7543aaef-7a9a-45b3-a45e-a8aeb06706a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f5ec29-9a56-4382-9d34-cdf22c449ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f5ec29-9a56-4382-9d34-cdf22c449ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1834024400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efda3da0-bf99-40f8-9a50-8170b163d897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f167de524ec34b6793ace867140954fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:18Z,use_quota=True,user_id='4ee358b025a54244bd700b16c1f9ca8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e969fc-370a-4d64-b0f7-c0741340ab5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23e969fc-370a-4d64-b0f7-c0741340ab5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84db723-af73-4d77-9dd6-7a417397e5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84db723-af73-4d77-9dd6-7a417397e5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efda3da0-bf99-40f8-9a50-8170b163d897', 'volume_name': 'volume-efda3da0-bf99-40f8-9a50-8170b163d897', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7680e9ff-cfe9-458c-8d93-779d7b470f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7680e9ff-cfe9-458c-8d93-779d7b470f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8280c564-9dcf-48bd-b88b-31a2c796c725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:18 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Volume efda3da0-bf99-40f8-9a50-8170b163d897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efda3da0-bf99-40f8-9a50-8170b163d897', 'volume_size': 1} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1834024400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efda3da0-bf99-40f8-9a50-8170b163d897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f167de524ec34b6793ace867140954fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:18Z,use_quota=True,user_id='4ee358b025a54244bd700b16c1f9ca8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Creating volume efda3da0-bf99-40f8-9a50-8170b163d897 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:57:18 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:57:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efda3da0-bf99-40f8-9a50-8170b163d897 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:18 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efda3da0-bf99-40f8-9a50-8170b163d897 1073741824 Sep 07 13:57:18 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:19 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efda3da0-bf99-40f8-9a50-8170b163d897 1073741824" returned: 0 in 0.723s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efda3da0-bf99-40f8-9a50-8170b163d897 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:19 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efda3da0-bf99-40f8-9a50-8170b163d897 Sep 07 13:57:19 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:19 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efda3da0-bf99-40f8-9a50-8170b163d897" returned: 0 in 0.560s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:57:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8280c564-9dcf-48bd-b88b-31a2c796c725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efda3da0-bf99-40f8-9a50-8170b163d897', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e1e200-713c-40a1-aa2a-8bd412ddaa88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:19 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Volume volume-efda3da0-bf99-40f8-9a50-8170b163d897 (efda3da0-bf99-40f8-9a50-8170b163d897): created successfully Sep 07 13:57:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65e1e200-713c-40a1-aa2a-8bd412ddaa88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Flow 'volume_create_manager' (7543aaef-7a9a-45b3-a45e-a8aeb06706a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:19 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2998a0da-65af-4805-8708-375b1da3e93b tempest-VolumesActionsTest-1135140198 None] Created volume successfully. Sep 07 13:57:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3b95d996-ec37-4744-a470-3567c110413b tempest-VolumesActionsTest-1135140198 None] Acquiring lock "cinder-efda3da0-bf99-40f8-9a50-8170b163d897" by "attach_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3b95d996-ec37-4744-a470-3567c110413b tempest-VolumesActionsTest-1135140198 None] Lock "cinder-efda3da0-bf99-40f8-9a50-8170b163d897" acquired by "attach_volume" :: waited 0.041s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3b95d996-ec37-4744-a470-3567c110413b tempest-VolumesActionsTest-1135140198 None] Attaching volume efda3da0-bf99-40f8-9a50-8170b163d897 to instance c2d52f59-32a6-4ba4-b5ec-e78a99fc10ad at mountpoint /dev/vdb on host None. Sep 07 13:57:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3b95d996-ec37-4744-a470-3567c110413b tempest-VolumesActionsTest-1135140198 None] Attach volume completed successfully. Sep 07 13:57:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3b95d996-ec37-4744-a470-3567c110413b tempest-VolumesActionsTest-1135140198 None] Lock "cinder-efda3da0-bf99-40f8-9a50-8170b163d897" released by "attach_volume" :: held 0.187s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a1c967da-263a-4591-b8ec-11e67ef4b078 tempest-VolumesActionsTest-737566334 None] Terminate volume connection completed successfully. Sep 07 13:57:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a1c967da-263a-4591-b8ec-11e67ef4b078 tempest-VolumesActionsTest-737566334 None] Acquiring lock "cinder-efda3da0-bf99-40f8-9a50-8170b163d897-detach_volume" by "detach_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a1c967da-263a-4591-b8ec-11e67ef4b078 tempest-VolumesActionsTest-737566334 None] Lock "cinder-efda3da0-bf99-40f8-9a50-8170b163d897-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a1c967da-263a-4591-b8ec-11e67ef4b078 tempest-VolumesActionsTest-737566334 None] Detaching volume efda3da0-bf99-40f8-9a50-8170b163d897 from instance c2d52f59-32a6-4ba4-b5ec-e78a99fc10ad. Sep 07 13:57:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a1c967da-263a-4591-b8ec-11e67ef4b078 tempest-VolumesActionsTest-737566334 None] Detach volume completed successfully. Sep 07 13:57:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a1c967da-263a-4591-b8ec-11e67ef4b078 tempest-VolumesActionsTest-737566334 None] Lock "cinder-efda3da0-bf99-40f8-9a50-8170b163d897-detach_volume" released by "detach_volume" :: held 0.170s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c46f6757-94b1-426c-9851-81d37ac412f2 tempest-VolumesActionsTest-1135140198 None] Acquiring lock "cinder-efda3da0-bf99-40f8-9a50-8170b163d897-detach_volume" by "detach_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c46f6757-94b1-426c-9851-81d37ac412f2 tempest-VolumesActionsTest-1135140198 None] Lock "cinder-efda3da0-bf99-40f8-9a50-8170b163d897-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c46f6757-94b1-426c-9851-81d37ac412f2 tempest-VolumesActionsTest-1135140198 None] Volume detach called, but volume not attached. Sep 07 13:57:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c46f6757-94b1-426c-9851-81d37ac412f2 tempest-VolumesActionsTest-1135140198 None] Lock "cinder-efda3da0-bf99-40f8-9a50-8170b163d897-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Acquiring lock "cinder-efda3da0-bf99-40f8-9a50-8170b163d897-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Lock "cinder-efda3da0-bf99-40f8-9a50-8170b163d897-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Acquiring lock "cinder-quobyte-efda3da0-bf99-40f8-9a50-8170b163d897" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Lock "cinder-quobyte-efda3da0-bf99-40f8-9a50-8170b163d897" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d085282-5659-4be2-93ed-4568b2a1528c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:57:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efda3da0-bf99-40f8-9a50-8170b163d897 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:23 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efda3da0-bf99-40f8-9a50-8170b163d897 Sep 07 13:57:23 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:23 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efda3da0-bf99-40f8-9a50-8170b163d897" returned: 0 in 0.477s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efda3da0-bf99-40f8-9a50-8170b163d897 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:23 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efda3da0-bf99-40f8-9a50-8170b163d897 Sep 07 13:57:23 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:23 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efda3da0-bf99-40f8-9a50-8170b163d897" returned: 0 in 0.274s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Lock "cinder-quobyte-efda3da0-bf99-40f8-9a50-8170b163d897" released by "delete_volume" :: held 0.836s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:23 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Created reservations ['03c1d1bb-7675-4728-9470-960be5ec2c3a', '44a6988d-950f-4a75-9013-46de99329cc3', 'aede1d4d-f10c-4275-aa73-1e94400afc2f', 'a6be162c-feb3-4132-a510-fbeebbb131e9'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:57:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:23 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:57:23 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:24 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.433s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:24 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Deleted volume successfully. Sep 07 13:57:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0b15420d-8a77-4377-983d-b1a736064152 tempest-VolumesActionsTest-1135140198 None] Lock "cinder-efda3da0-bf99-40f8-9a50-8170b163d897-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Flow 'volume_create_manager' (093a5ccd-c99a-47aa-b1c6-86fb7445652c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6508c03-6ce2-47f5-9973-e788dbd4b3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6508c03-6ce2-47f5-9973-e788dbd4b3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-791662295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376e7639-73a6-420d-b591-c8d210e4e1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f167de524ec34b6793ace867140954fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:28Z,use_quota=True,user_id='4ee358b025a54244bd700b16c1f9ca8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4c0f66-f149-48f9-8cc1-965c0e12b767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4c0f66-f149-48f9-8cc1-965c0e12b767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca73685-bd49-4f9f-9a19-348672cf5018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ca73685-bd49-4f9f-9a19-348672cf5018) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376e7639-73a6-420d-b591-c8d210e4e1d5', 'volume_name': 'volume-376e7639-73a6-420d-b591-c8d210e4e1d5', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df6dfa0-1bc6-421d-9164-a7fea28902f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1df6dfa0-1bc6-421d-9164-a7fea28902f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91b635d-8d9c-4596-b8aa-df59e6debd2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:27 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Volume 376e7639-73a6-420d-b591-c8d210e4e1d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376e7639-73a6-420d-b591-c8d210e4e1d5', 'volume_size': 1} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-791662295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376e7639-73a6-420d-b591-c8d210e4e1d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f167de524ec34b6793ace867140954fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:28Z,use_quota=True,user_id='4ee358b025a54244bd700b16c1f9ca8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Creating volume 376e7639-73a6-420d-b591-c8d210e4e1d5 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:57:27 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:57:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-376e7639-73a6-420d-b591-c8d210e4e1d5 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:27 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-376e7639-73a6-420d-b591-c8d210e4e1d5 1073741824 Sep 07 13:57:27 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:28 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-376e7639-73a6-420d-b591-c8d210e4e1d5 1073741824" returned: 0 in 0.425s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-376e7639-73a6-420d-b591-c8d210e4e1d5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:28 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-376e7639-73a6-420d-b591-c8d210e4e1d5 Sep 07 13:57:28 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:28 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-376e7639-73a6-420d-b591-c8d210e4e1d5" returned: 0 in 0.250s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:57:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91b635d-8d9c-4596-b8aa-df59e6debd2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376e7639-73a6-420d-b591-c8d210e4e1d5', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d59c8d-05d7-4aa1-81e7-c51729552781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:28 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Volume volume-376e7639-73a6-420d-b591-c8d210e4e1d5 (376e7639-73a6-420d-b591-c8d210e4e1d5): created successfully Sep 07 13:57:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54d59c8d-05d7-4aa1-81e7-c51729552781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Flow 'volume_create_manager' (093a5ccd-c99a-47aa-b1c6-86fb7445652c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-987690d2-1608-4dcf-874b-bf6d1a734584 tempest-VolumesActionsTest-1135140198 None] Created volume successfully. Sep 07 13:57:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Acquiring lock "cinder-376e7639-73a6-420d-b591-c8d210e4e1d5-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Lock "cinder-376e7639-73a6-420d-b591-c8d210e4e1d5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Acquiring lock "cinder-quobyte-376e7639-73a6-420d-b591-c8d210e4e1d5" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Lock "cinder-quobyte-376e7639-73a6-420d-b591-c8d210e4e1d5" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:28 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[77461306-a52e-45f2-8215-64152562b4a0]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:57:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-376e7639-73a6-420d-b591-c8d210e4e1d5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:28 devstack sudo[101969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-376e7639-73a6-420d-b591-c8d210e4e1d5 Sep 07 13:57:28 devstack sudo[101969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:29 devstack sudo[101969]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-376e7639-73a6-420d-b591-c8d210e4e1d5" returned: 0 in 0.366s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-376e7639-73a6-420d-b591-c8d210e4e1d5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:29 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-376e7639-73a6-420d-b591-c8d210e4e1d5 Sep 07 13:57:29 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:29 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-376e7639-73a6-420d-b591-c8d210e4e1d5" returned: 0 in 0.265s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Lock "cinder-quobyte-376e7639-73a6-420d-b591-c8d210e4e1d5" released by "delete_volume" :: held 0.674s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Created reservations ['36f88498-2c08-4321-837b-52f58e664d8f', '698e98f8-a69c-4abe-983c-3031edc80c56', '7f0147af-dc30-4828-91de-1e4f772c91ee', 'f6402364-355a-48f7-b9d6-f969479486c3'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:29 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:57:29 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:29 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:57:29 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:29 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.316s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Deleted volume successfully. Sep 07 13:57:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d9d57729-d748-450e-817b-72aac74e54c0 tempest-VolumesActionsTest-737566334 None] Lock "cinder-376e7639-73a6-420d-b591-c8d210e4e1d5-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:30 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.332s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 29 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Flow 'volume_create_manager' (11d201c4-a5cf-4480-ba8d-59ef121a4ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2c00f3-e63e-4e1e-8acb-02274f33927e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c2c00f3-e63e-4e1e-8acb-02274f33927e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2049566655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc23f594-fc1e-455f-8fdc-acbd523bfb5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f167de524ec34b6793ace867140954fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:30Z,use_quota=True,user_id='4ee358b025a54244bd700b16c1f9ca8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc68b76a-fe21-40a2-8ee0-8f4a96bf852a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc68b76a-fe21-40a2-8ee0-8f4a96bf852a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caac2cab-bae3-4035-825f-7e0d1b557476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (caac2cab-bae3-4035-825f-7e0d1b557476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc23f594-fc1e-455f-8fdc-acbd523bfb5a', 'volume_name': 'volume-cc23f594-fc1e-455f-8fdc-acbd523bfb5a', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c7b93b-2c2f-4d43-aa2d-b19d6aa4cf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90c7b93b-2c2f-4d43-aa2d-b19d6aa4cf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0f3334-9ba1-40ef-8201-6ee6cf54000d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:30 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Volume cc23f594-fc1e-455f-8fdc-acbd523bfb5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc23f594-fc1e-455f-8fdc-acbd523bfb5a', 'volume_size': 1} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2049566655',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc23f594-fc1e-455f-8fdc-acbd523bfb5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f167de524ec34b6793ace867140954fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:30Z,use_quota=True,user_id='4ee358b025a54244bd700b16c1f9ca8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Creating volume cc23f594-fc1e-455f-8fdc-acbd523bfb5a {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:57:30 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:57:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cc23f594-fc1e-455f-8fdc-acbd523bfb5a 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:30 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cc23f594-fc1e-455f-8fdc-acbd523bfb5a 1073741824 Sep 07 13:57:30 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:31 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cc23f594-fc1e-455f-8fdc-acbd523bfb5a 1073741824" returned: 0 in 0.440s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cc23f594-fc1e-455f-8fdc-acbd523bfb5a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:31 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cc23f594-fc1e-455f-8fdc-acbd523bfb5a Sep 07 13:57:31 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:31 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cc23f594-fc1e-455f-8fdc-acbd523bfb5a" returned: 0 in 0.267s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:57:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d0f3334-9ba1-40ef-8201-6ee6cf54000d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc23f594-fc1e-455f-8fdc-acbd523bfb5a', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96ab514-df95-4b0f-b14a-7a2a2a75083f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:31 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Volume volume-cc23f594-fc1e-455f-8fdc-acbd523bfb5a (cc23f594-fc1e-455f-8fdc-acbd523bfb5a): created successfully Sep 07 13:57:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96ab514-df95-4b0f-b14a-7a2a2a75083f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Flow 'volume_create_manager' (11d201c4-a5cf-4480-ba8d-59ef121a4ede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a41de421-5d60-4301-9520-8015e46f7f7e tempest-VolumesActionsTest-1135140198 None] Created volume successfully. Sep 07 13:57:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Acquiring lock "cinder-cc23f594-fc1e-455f-8fdc-acbd523bfb5a-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Lock "cinder-cc23f594-fc1e-455f-8fdc-acbd523bfb5a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Acquiring lock "cinder-quobyte-cc23f594-fc1e-455f-8fdc-acbd523bfb5a" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Lock "cinder-quobyte-cc23f594-fc1e-455f-8fdc-acbd523bfb5a" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:31 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42bfb4b-28cd-42da-96d6-1a1ad9e251b1]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:57:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cc23f594-fc1e-455f-8fdc-acbd523bfb5a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:31 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cc23f594-fc1e-455f-8fdc-acbd523bfb5a Sep 07 13:57:31 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:32 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cc23f594-fc1e-455f-8fdc-acbd523bfb5a" returned: 0 in 0.404s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cc23f594-fc1e-455f-8fdc-acbd523bfb5a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:32 devstack sudo[101996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cc23f594-fc1e-455f-8fdc-acbd523bfb5a Sep 07 13:57:32 devstack sudo[101996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:32 devstack sudo[101996]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cc23f594-fc1e-455f-8fdc-acbd523bfb5a" returned: 0 in 0.287s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Lock "cinder-quobyte-cc23f594-fc1e-455f-8fdc-acbd523bfb5a" released by "delete_volume" :: held 0.732s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:32 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Created reservations ['5ccf2160-406f-4c07-8478-9186b1360a21', '151b467d-c234-4254-8a81-4a38e8a7c556', '49fcd002-e283-4918-988b-d253cad252cf', '597da33c-00d0-40e5-8320-1cde6218ab80'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:57:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:32 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:57:32 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:32 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.279s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:32 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Deleted volume successfully. Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa2b1de5-2ea6-4660-877e-20fcfd383f1d tempest-VolumesActionsTest-737566334 None] Lock "cinder-cc23f594-fc1e-455f-8fdc-acbd523bfb5a-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Flow 'volume_create_manager' (772d5c93-128e-4355-a703-3b1acb05f986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (753c9e58-99d5-46cd-bd6a-4c21e8c9597b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (753c9e58-99d5-46cd-bd6a-4c21e8c9597b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1043125431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c1abfc-7c56-4eb4-aa06-9b287bc07cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f167de524ec34b6793ace867140954fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:34Z,use_quota=True,user_id='4ee358b025a54244bd700b16c1f9ca8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f8f54f-1873-435b-9a4f-6a6c3aa17b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f8f54f-1873-435b-9a4f-6a6c3aa17b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e95a974-d81c-4e59-8642-d3980f3f5b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e95a974-d81c-4e59-8642-d3980f3f5b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c1abfc-7c56-4eb4-aa06-9b287bc07cb5', 'volume_name': 'volume-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94303705-345c-444c-aadd-da17e8757eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94303705-345c-444c-aadd-da17e8757eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c83d708-19e4-4b39-9e44-113256cadbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:33 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Volume 35c1abfc-7c56-4eb4-aa06-9b287bc07cb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5', 'volume_size': 1} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1043125431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c1abfc-7c56-4eb4-aa06-9b287bc07cb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f167de524ec34b6793ace867140954fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:34Z,use_quota=True,user_id='4ee358b025a54244bd700b16c1f9ca8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Creating volume 35c1abfc-7c56-4eb4-aa06-9b287bc07cb5 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:57:33 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:57:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:33 devstack sudo[102023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5 1073741824 Sep 07 13:57:33 devstack sudo[102023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:34 devstack sudo[102023]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5 1073741824" returned: 0 in 0.565s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:34 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5 Sep 07 13:57:34 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:34 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5" returned: 0 in 0.291s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:57:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c83d708-19e4-4b39-9e44-113256cadbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fff644f-7150-4f37-844d-37f33f6143a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:34 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Volume volume-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5 (35c1abfc-7c56-4eb4-aa06-9b287bc07cb5): created successfully Sep 07 13:57:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fff644f-7150-4f37-844d-37f33f6143a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Flow 'volume_create_manager' (772d5c93-128e-4355-a703-3b1acb05f986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:34 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-83deaa48-7325-4ea1-9da1-133864b078c4 tempest-VolumesActionsTest-1135140198 None] Created volume successfully. Sep 07 13:57:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Acquiring lock "cinder-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Lock "cinder-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Acquiring lock "cinder-quobyte-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Lock "cinder-quobyte-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:35 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1138b0a3-8b82-450e-b2be-8dc7fd18e939]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:57:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:36 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5 Sep 07 13:57:36 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:36 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5" returned: 0 in 0.391s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:36 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5 Sep 07 13:57:36 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:36 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5" returned: 0 in 0.269s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Lock "cinder-quobyte-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5" released by "delete_volume" :: held 0.697s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:36 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Created reservations ['bc78a9fe-4698-4609-9843-9bbf65d1e82a', 'eeacc721-9b59-4eab-9b67-9261aae7abdb', 'dba5f7ce-96bf-4e5d-816d-b1452db444ce', '26513afd-2aeb-45a1-917c-bca2613004d6'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:57:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:36 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:57:36 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:36 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.263s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:36 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:36 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Deleted volume successfully. Sep 07 13:57:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a4abebb-9fd4-4bc3-b167-c56248d33f52 tempest-VolumesActionsTest-737566334 None] Lock "cinder-35c1abfc-7c56-4eb4-aa06-9b287bc07cb5-delete_volume" released by "delete_volume" :: held 1.174s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Flow 'volume_create_manager' (47bec0d0-7c07-4a6d-b4c0-0d120b9fdc53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4357a8-7891-4a0a-940e-c58a5118fe9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da4357a8-7891-4a0a-940e-c58a5118fe9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1255665934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e2cafb-a740-4d01-abfb-702e3d51591b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f167de524ec34b6793ace867140954fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:37Z,use_quota=True,user_id='4ee358b025a54244bd700b16c1f9ca8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78e5917-8946-4049-91c0-1b1e51b86590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78e5917-8946-4049-91c0-1b1e51b86590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b69d04a-0803-43da-b87b-4aa31d56ab0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b69d04a-0803-43da-b87b-4aa31d56ab0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90e2cafb-a740-4d01-abfb-702e3d51591b', 'volume_name': 'volume-90e2cafb-a740-4d01-abfb-702e3d51591b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8f4ada-403c-480b-843e-77d09d350e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b8f4ada-403c-480b-843e-77d09d350e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47da3a0b-7ba9-4782-9bbd-4c1125897fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:37 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Volume 90e2cafb-a740-4d01-abfb-702e3d51591b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90e2cafb-a740-4d01-abfb-702e3d51591b', 'volume_size': 1} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1255665934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e2cafb-a740-4d01-abfb-702e3d51591b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f167de524ec34b6793ace867140954fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:37Z,use_quota=True,user_id='4ee358b025a54244bd700b16c1f9ca8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Creating volume 90e2cafb-a740-4d01-abfb-702e3d51591b {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:57:37 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-90e2cafb-a740-4d01-abfb-702e3d51591b 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:37 devstack sudo[102044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-90e2cafb-a740-4d01-abfb-702e3d51591b 1073741824 Sep 07 13:57:37 devstack sudo[102044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:37 devstack sudo[102044]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-90e2cafb-a740-4d01-abfb-702e3d51591b 1073741824" returned: 0 in 0.416s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-90e2cafb-a740-4d01-abfb-702e3d51591b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:38 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-90e2cafb-a740-4d01-abfb-702e3d51591b Sep 07 13:57:38 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:38 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-90e2cafb-a740-4d01-abfb-702e3d51591b" returned: 0 in 0.241s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:57:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47da3a0b-7ba9-4782-9bbd-4c1125897fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e2cafb-a740-4d01-abfb-702e3d51591b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d800d2-04ff-41a6-b7b8-17837d9c815c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:38 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Volume volume-90e2cafb-a740-4d01-abfb-702e3d51591b (90e2cafb-a740-4d01-abfb-702e3d51591b): created successfully Sep 07 13:57:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d800d2-04ff-41a6-b7b8-17837d9c815c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Flow 'volume_create_manager' (47bec0d0-7c07-4a6d-b4c0-0d120b9fdc53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:38 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e18bfaf9-b361-42dc-ba4e-8f62b22cd26f tempest-VolumesActionsTest-1135140198 None] Created volume successfully. Sep 07 13:57:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Acquiring lock "cinder-90e2cafb-a740-4d01-abfb-702e3d51591b-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Lock "cinder-90e2cafb-a740-4d01-abfb-702e3d51591b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Acquiring lock "cinder-quobyte-90e2cafb-a740-4d01-abfb-702e3d51591b" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Lock "cinder-quobyte-90e2cafb-a740-4d01-abfb-702e3d51591b" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:38 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbe51b3-6dd6-4ddb-b5a9-d6c80be160ac]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:57:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-90e2cafb-a740-4d01-abfb-702e3d51591b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:38 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-90e2cafb-a740-4d01-abfb-702e3d51591b Sep 07 13:57:38 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:39 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-90e2cafb-a740-4d01-abfb-702e3d51591b" returned: 0 in 0.356s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-90e2cafb-a740-4d01-abfb-702e3d51591b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:39 devstack sudo[102058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-90e2cafb-a740-4d01-abfb-702e3d51591b Sep 07 13:57:39 devstack sudo[102058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:39 devstack sudo[102058]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-90e2cafb-a740-4d01-abfb-702e3d51591b" returned: 0 in 0.239s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Lock "cinder-quobyte-90e2cafb-a740-4d01-abfb-702e3d51591b" released by "delete_volume" :: held 0.634s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:39 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Created reservations ['7681d065-ed8c-4330-b487-6355f37ecb7b', '90241830-b299-4d7e-b66f-c3c6849948a5', '4934a645-8f14-41b2-a176-0b0dc64d3271', '35a95516-c1dd-47cf-88d9-578050485c5c'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:57:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:39 devstack sudo[102063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:57:39 devstack sudo[102063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:39 devstack sudo[102063]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.248s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:39 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:39 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Deleted volume successfully. Sep 07 13:57:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aa1f7fb2-30b2-4b95-a222-5c99f3f8c067 tempest-VolumesActionsTest-737566334 None] Lock "cinder-90e2cafb-a740-4d01-abfb-702e3d51591b-delete_volume" released by "delete_volume" :: held 1.086s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Flow 'volume_create_manager' (2c24164e-5267-4e18-a285-e4cce8bd9978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1f1912-dce3-4e21-8717-f1c9c8966267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a1f1912-dce3-4e21-8717-f1c9c8966267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-169686177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbc1a66-e603-44fa-af45-e065dbdc42ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f167de524ec34b6793ace867140954fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:40Z,use_quota=True,user_id='4ee358b025a54244bd700b16c1f9ca8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44dc3dec-f67a-424b-a8c0-380d013e9637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44dc3dec-f67a-424b-a8c0-380d013e9637) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e56cf0c-1369-4ffe-b2cc-2baec8c87a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e56cf0c-1369-4ffe-b2cc-2baec8c87a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dbc1a66-e603-44fa-af45-e065dbdc42ea', 'volume_name': 'volume-2dbc1a66-e603-44fa-af45-e065dbdc42ea', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ba0d7c-e9b6-4190-9920-25330571d26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52ba0d7c-e9b6-4190-9920-25330571d26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd99c41-514a-4bdc-bb43-8c10734f394a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:40 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Volume 2dbc1a66-e603-44fa-af45-e065dbdc42ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dbc1a66-e603-44fa-af45-e065dbdc42ea', 'volume_size': 1} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-169686177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dbc1a66-e603-44fa-af45-e065dbdc42ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f167de524ec34b6793ace867140954fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:57:40Z,use_quota=True,user_id='4ee358b025a54244bd700b16c1f9ca8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Creating volume 2dbc1a66-e603-44fa-af45-e065dbdc42ea {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:57:40 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2dbc1a66-e603-44fa-af45-e065dbdc42ea 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:40 devstack sudo[102066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2dbc1a66-e603-44fa-af45-e065dbdc42ea 1073741824 Sep 07 13:57:40 devstack sudo[102066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:40 devstack sudo[102066]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2dbc1a66-e603-44fa-af45-e065dbdc42ea 1073741824" returned: 0 in 0.454s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2dbc1a66-e603-44fa-af45-e065dbdc42ea {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:40 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2dbc1a66-e603-44fa-af45-e065dbdc42ea Sep 07 13:57:40 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:41 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2dbc1a66-e603-44fa-af45-e065dbdc42ea" returned: 0 in 0.256s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:57:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd99c41-514a-4bdc-bb43-8c10734f394a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dbc1a66-e603-44fa-af45-e065dbdc42ea', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d2b5a8-04e2-4318-afd9-2c4241151172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:57:41 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Volume volume-2dbc1a66-e603-44fa-af45-e065dbdc42ea (2dbc1a66-e603-44fa-af45-e065dbdc42ea): created successfully Sep 07 13:57:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d2b5a8-04e2-4318-afd9-2c4241151172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:57:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Flow 'volume_create_manager' (2c24164e-5267-4e18-a285-e4cce8bd9978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:57:41 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1d02a8de-0f7d-4d95-ab37-8a17f4586a8c tempest-VolumesActionsTest-1135140198 None] Created volume successfully. Sep 07 13:57:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Acquiring lock "cinder-2dbc1a66-e603-44fa-af45-e065dbdc42ea-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Lock "cinder-2dbc1a66-e603-44fa-af45-e065dbdc42ea-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Acquiring lock "cinder-quobyte-2dbc1a66-e603-44fa-af45-e065dbdc42ea" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Lock "cinder-quobyte-2dbc1a66-e603-44fa-af45-e065dbdc42ea" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:42 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32aa7a8-a50d-4a3c-8d08-6940b0b93bee]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:57:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2dbc1a66-e603-44fa-af45-e065dbdc42ea {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:42 devstack sudo[102075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2dbc1a66-e603-44fa-af45-e065dbdc42ea Sep 07 13:57:42 devstack sudo[102075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:42 devstack sudo[102075]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2dbc1a66-e603-44fa-af45-e065dbdc42ea" returned: 0 in 0.382s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2dbc1a66-e603-44fa-af45-e065dbdc42ea {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:42 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2dbc1a66-e603-44fa-af45-e065dbdc42ea Sep 07 13:57:42 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:42 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2dbc1a66-e603-44fa-af45-e065dbdc42ea" returned: 0 in 0.242s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Lock "cinder-quobyte-2dbc1a66-e603-44fa-af45-e065dbdc42ea" released by "delete_volume" :: held 0.673s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:42 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Created reservations ['3a35a04f-2b3a-4292-a73e-c4b15578f0b5', '7a4ea5fb-8b06-42c6-8a90-5271e66e0e24', 'b80111ff-5b5c-426d-8a3b-88b9d177fcac', '39b95810-8116-4c92-9895-4a0196045dd9'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:57:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:42 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:57:42 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:43 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.257s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:43 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Deleted volume successfully. Sep 07 13:57:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-22fef996-55ce-4387-b11d-ada5451f6b04 tempest-VolumesActionsTest-1135140198 None] Lock "cinder-2dbc1a66-e603-44fa-af45-e065dbdc42ea-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-f1bd9708-a01c-4545-85e7-1e9ab9d451bb req-e2efc835-d0ab-4bf3-bd0b-d669ece22aa2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-f1bd9708-a01c-4545-85e7-1e9ab9d451bb req-e2efc835-d0ab-4bf3-bd0b-d669ece22aa2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-f1bd9708-a01c-4545-85e7-1e9ab9d451bb req-e2efc835-d0ab-4bf3-bd0b-d669ece22aa2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-f1bd9708-a01c-4545-85e7-1e9ab9d451bb req-e2efc835-d0ab-4bf3-bd0b-d669ece22aa2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce19be30-b35a-4b43-b3ca-99b49676671e', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:57:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-f1bd9708-a01c-4545-85e7-1e9ab9d451bb req-e2efc835-d0ab-4bf3-bd0b-d669ece22aa2 tempest-TestServerVolumeAttachmentScenario-1452997354 None] attachment_update completed successfully. Sep 07 13:57:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-b78a9ab6-1e6c-4857-90fc-113143fc7665 req-8b9f6c77-715d-4427-ad7f-4817a75cf470 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-b78a9ab6-1e6c-4857-90fc-113143fc7665 req-8b9f6c77-715d-4427-ad7f-4817a75cf470 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-b78a9ab6-1e6c-4857-90fc-113143fc7665 req-8b9f6c77-715d-4427-ad7f-4817a75cf470 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-b78a9ab6-1e6c-4857-90fc-113143fc7665 req-8b9f6c77-715d-4427-ad7f-4817a75cf470 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-993d7366-900e-42bf-a97c-f5e4503cb162', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd0cef216-b046-4891-bf62-9fdc09aca7be', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:57:48 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-b78a9ab6-1e6c-4857-90fc-113143fc7665 req-8b9f6c77-715d-4427-ad7f-4817a75cf470 tempest-TestServerVolumeAttachmentScenario-1452997354 None] attachment_update completed successfully. Sep 07 13:57:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-8da630bc-c2aa-4ca1-aa68-2898a4144bec req-5f8aab05-98f2-4f0c-8408-fd483aff5aff tempest-TestMinimumBasicScenario-885128730 None] Terminate volume connection completed successfully. Sep 07 13:57:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-8da630bc-c2aa-4ca1-aa68-2898a4144bec req-5f8aab05-98f2-4f0c-8408-fd483aff5aff tempest-TestMinimumBasicScenario-885128730 None] Deleting attachment 23ba21ef-1297-4394-b515-b002ebdcc83a. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:57:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Acquiring lock "cinder-631164d8-69fb-452b-86bd-4a67bca04cb7-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Lock "cinder-631164d8-69fb-452b-86bd-4a67bca04cb7-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Acquiring lock "cinder-quobyte-631164d8-69fb-452b-86bd-4a67bca04cb7" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:51 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-031fbcfe-5b50-4fb5-9ed0-f2f8dd1cc32b req-554b704e-28b4-452b-9ddf-5e6c68871711 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Terminate volume connection completed successfully. Sep 07 13:57:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-031fbcfe-5b50-4fb5-9ed0-f2f8dd1cc32b req-554b704e-28b4-452b-9ddf-5e6c68871711 tempest-TestServerVolumeAttachmentScenario-1452997354 None] Deleting attachment d0cef216-b046-4891-bf62-9fdc09aca7be. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:57:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Lock "cinder-quobyte-631164d8-69fb-452b-86bd-4a67bca04cb7" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:51 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f5f1720-12fd-4b25-aedb-27ce47f3972f]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:57:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-631164d8-69fb-452b-86bd-4a67bca04cb7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:51 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-631164d8-69fb-452b-86bd-4a67bca04cb7 Sep 07 13:57:51 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:51 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-631164d8-69fb-452b-86bd-4a67bca04cb7" returned: 0 in 0.404s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-631164d8-69fb-452b-86bd-4a67bca04cb7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:51 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-631164d8-69fb-452b-86bd-4a67bca04cb7 Sep 07 13:57:51 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:52 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-631164d8-69fb-452b-86bd-4a67bca04cb7" returned: 0 in 0.262s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Lock "cinder-quobyte-631164d8-69fb-452b-86bd-4a67bca04cb7" released by "delete_volume" :: held 0.728s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:52 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Created reservations ['ba889367-dd94-4a51-b3f4-3079fac3069c', 'ae9ce840-9fb1-4a13-b2fb-dd7141cbe6cd', '927a2718-7af2-4b46-b216-fe73a692a3bd', '50220811-2059-43f8-854f-3421d6c9b60f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:57:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:57:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:57:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:57:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:57:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:57:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:52 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:57:52 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:52 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.386s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:52 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:57:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Deleted volume successfully. Sep 07 13:57:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd06e118-d9fa-4cbc-9c8e-2402931af443 tempest-TestMinimumBasicScenario-885128730 None] Lock "cinder-631164d8-69fb-452b-86bd-4a67bca04cb7-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:57:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-c7b1850d-2770-4e78-af61-27ee4f531954 req-1b8ea810-c396-486b-93a1-c6d01141f7ef tempest-TestServerVolumeAttachmentScenario-1452997354 None] Terminate volume connection completed successfully. Sep 07 13:57:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-c7b1850d-2770-4e78-af61-27ee4f531954 req-1b8ea810-c396-486b-93a1-c6d01141f7ef tempest-TestServerVolumeAttachmentScenario-1452997354 None] Deleting attachment ce19be30-b35a-4b43-b3ca-99b49676671e. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:57:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Acquiring lock "cinder-993d7366-900e-42bf-a97c-f5e4503cb162-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "cinder-993d7366-900e-42bf-a97c-f5e4503cb162-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Acquiring lock "cinder-quobyte-993d7366-900e-42bf-a97c-f5e4503cb162" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:57:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "cinder-quobyte-993d7366-900e-42bf-a97c-f5e4503cb162" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:57:59 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[354847c2-9e00-4cc8-b7c4-b978c108d16d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:57:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-993d7366-900e-42bf-a97c-f5e4503cb162 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:59 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-993d7366-900e-42bf-a97c-f5e4503cb162 Sep 07 13:57:59 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:59 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-993d7366-900e-42bf-a97c-f5e4503cb162" returned: 0 in 0.420s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-993d7366-900e-42bf-a97c-f5e4503cb162 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:57:59 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-993d7366-900e-42bf-a97c-f5e4503cb162 Sep 07 13:57:59 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:57:59 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Sep 07 13:57:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-993d7366-900e-42bf-a97c-f5e4503cb162" returned: 0 in 0.268s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:57:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "cinder-quobyte-993d7366-900e-42bf-a97c-f5e4503cb162" released by "delete_volume" :: held 0.753s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:00 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Created reservations ['c08f5360-63c3-4b02-8602-590eb024c218', 'fb75a99d-163d-4890-a887-5c93693bdf1a', 'bd4e7ea7-e532-45ef-b366-be2cdea6c1c3', '03c667ed-ab9d-40bd-a10a-8a6afdc4e6cd'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:00 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:58:00 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Acquiring lock "cinder-f4c848b0-5ae9-47c9-bbfe-d6c066855406-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "cinder-f4c848b0-5ae9-47c9-bbfe-d6c066855406-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Acquiring lock "cinder-quobyte-f4c848b0-5ae9-47c9-bbfe-d6c066855406" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "cinder-quobyte-f4c848b0-5ae9-47c9-bbfe-d6c066855406" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:00 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.450s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:00 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0367b6-b3e0-4c30-a56c-9dcc2d55e09d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:00 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Deleted volume successfully. Sep 07 13:58:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8084df6-194e-4627-977c-97c15d4a93bd tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "cinder-993d7366-900e-42bf-a97c-f5e4503cb162-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:00 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406 Sep 07 13:58:00 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:01 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406" returned: 0 in 0.437s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:01 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406 Sep 07 13:58:01 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:01 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f4c848b0-5ae9-47c9-bbfe-d6c066855406" returned: 0 in 0.286s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "cinder-quobyte-f4c848b0-5ae9-47c9-bbfe-d6c066855406" released by "delete_volume" :: held 0.823s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:01 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Created reservations ['7df14c6a-f20f-446e-8b36-e986f81c2fe9', '365eea37-8215-48ba-8044-0c51363a97ad', '45485baa-e02e-4593-ba59-a3ac82f8d94a', '8f9da6d2-77e8-47e9-a5a7-3e9100087b7c'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:01 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:58:01 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:01 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.313s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:01 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Deleted volume successfully. Sep 07 13:58:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7413c7e6-1b40-4a0b-b6d6-f882b81ad28f tempest-TestServerVolumeAttachmentScenario-1452997354 None] Lock "cinder-f4c848b0-5ae9-47c9-bbfe-d6c066855406-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Flow 'volume_create_manager' (76f4c6ba-3b7a-4b5a-a41f-9ae70c1d05c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4a2f8c-06c8-4786-9d8b-f60ad9259b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f4a2f8c-06c8-4786-9d8b-f60ad9259b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1392919795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=373f9f29-762d-4757-a3bb-a8e72693b115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af4793e6df9498eb3b325614b5349f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:05Z,use_quota=True,user_id='7e4230c66ca6454fb064bbb744b1b06f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58c1304-4c68-4624-9e16-3cbbd2fbf261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e58c1304-4c68-4624-9e16-3cbbd2fbf261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aca32f8-b11f-445b-a5d0-b83ec9cf14b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aca32f8-b11f-445b-a5d0-b83ec9cf14b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '373f9f29-762d-4757-a3bb-a8e72693b115', 'volume_name': 'volume-373f9f29-762d-4757-a3bb-a8e72693b115', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7704a87-c6fe-4b80-8545-e5a11574c74d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7704a87-c6fe-4b80-8545-e5a11574c74d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd3b3fd-6883-4eab-b4f7-b6838148c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:04 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Volume 373f9f29-762d-4757-a3bb-a8e72693b115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-373f9f29-762d-4757-a3bb-a8e72693b115', 'volume_size': 1} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1392919795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=373f9f29-762d-4757-a3bb-a8e72693b115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af4793e6df9498eb3b325614b5349f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:05Z,use_quota=True,user_id='7e4230c66ca6454fb064bbb744b1b06f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Creating volume 373f9f29-762d-4757-a3bb-a8e72693b115 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:05 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:58:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-373f9f29-762d-4757-a3bb-a8e72693b115 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:05 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-373f9f29-762d-4757-a3bb-a8e72693b115 1073741824 Sep 07 13:58:05 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:05 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-373f9f29-762d-4757-a3bb-a8e72693b115 1073741824" returned: 0 in 0.452s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-373f9f29-762d-4757-a3bb-a8e72693b115 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:05 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-373f9f29-762d-4757-a3bb-a8e72693b115 Sep 07 13:58:05 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:05 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-373f9f29-762d-4757-a3bb-a8e72693b115" returned: 0 in 0.315s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] <== create_volume: return (833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd3b3fd-6883-4eab-b4f7-b6838148c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-373f9f29-762d-4757-a3bb-a8e72693b115', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3b1200-e855-4cc6-a4f5-1b16d8d7c6de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:05 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Volume volume-373f9f29-762d-4757-a3bb-a8e72693b115 (373f9f29-762d-4757-a3bb-a8e72693b115): created successfully Sep 07 13:58:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe3b1200-e855-4cc6-a4f5-1b16d8d7c6de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Flow 'volume_create_manager' (76f4c6ba-3b7a-4b5a-a41f-9ae70c1d05c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:05 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a86122b1-e4fe-4e6e-a832-6c89a5dfa94d tempest-AbsoluteLimitsTests-1020927928 None] Created volume successfully. Sep 07 13:58:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Acquiring lock "cinder-373f9f29-762d-4757-a3bb-a8e72693b115-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Lock "cinder-373f9f29-762d-4757-a3bb-a8e72693b115-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Acquiring lock "cinder-quobyte-373f9f29-762d-4757-a3bb-a8e72693b115" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Lock "cinder-quobyte-373f9f29-762d-4757-a3bb-a8e72693b115" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb899dc0-3556-44ab-b5a4-3dec292865ea]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-373f9f29-762d-4757-a3bb-a8e72693b115 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:07 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-373f9f29-762d-4757-a3bb-a8e72693b115 Sep 07 13:58:07 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:08 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-373f9f29-762d-4757-a3bb-a8e72693b115" returned: 0 in 0.479s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-373f9f29-762d-4757-a3bb-a8e72693b115 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:08 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-373f9f29-762d-4757-a3bb-a8e72693b115 Sep 07 13:58:08 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:08 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-373f9f29-762d-4757-a3bb-a8e72693b115" returned: 0 in 0.328s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Lock "cinder-quobyte-373f9f29-762d-4757-a3bb-a8e72693b115" released by "delete_volume" :: held 0.853s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Created reservations ['a12a8573-312e-4fa4-ac2e-89214dd80645', '3d9ad336-8cfe-4002-8c48-a0c0c16869b2', '51075a62-4b2f-4176-8dcd-5764e73da82a', '4f44e542-d527-46c5-9f88-d8cecca64de2'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:08 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:58:08 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:09 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.401s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:09 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Deleted volume successfully. Sep 07 13:58:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f1de998-1c42-4658-a134-9a9c07121d98 tempest-AbsoluteLimitsTests-1020927928 None] Lock "cinder-373f9f29-762d-4757-a3bb-a8e72693b115-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=88,cinder:UPDATE=111,cinder:INSERT=24,cinder:DELETE=9 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=88,cinder:UPDATE=105,cinder:DELETE=8,cinder:INSERT=25 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Flow 'volume_create_manager' (2e333526-752c-4be6-b53a-7a14ba181e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a18f5e-48da-4598-b4e6-7e9682d46ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72a18f5e-48da-4598-b4e6-7e9682d46ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21abf20a-ba46-4e3a-a919-bd4194262778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='136b2ff5c9cd4a518d108a56286ff7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:16Z,use_quota=True,user_id='07b2a8dea1a548798ab2ffc9a4863661',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b34a56f-641b-48b7-980a-92cbabd9a222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b34a56f-641b-48b7-980a-92cbabd9a222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7237d50-5e7b-42b1-b992-97d741bcdebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7237d50-5e7b-42b1-b992-97d741bcdebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21abf20a-ba46-4e3a-a919-bd4194262778', 'volume_name': 'volume-21abf20a-ba46-4e3a-a919-bd4194262778', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a66b33a-8686-4ff2-9517-73fc00cbec68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a66b33a-8686-4ff2-9517-73fc00cbec68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d830b4-7775-42af-a0f5-fa409db699fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Volume 21abf20a-ba46-4e3a-a919-bd4194262778: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21abf20a-ba46-4e3a-a919-bd4194262778', 'volume_size': 1} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21abf20a-ba46-4e3a-a919-bd4194262778,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='136b2ff5c9cd4a518d108a56286ff7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:16Z,use_quota=True,user_id='07b2a8dea1a548798ab2ffc9a4863661',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Creating volume 21abf20a-ba46-4e3a-a919-bd4194262778 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:16 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-21abf20a-ba46-4e3a-a919-bd4194262778 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:16 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-21abf20a-ba46-4e3a-a919-bd4194262778 1073741824 Sep 07 13:58:16 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Flow 'volume_create_manager' (c13e6466-2609-4fa6-bbe9-89239811950c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213ca857-442d-46b1-945c-ac68b9d850df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (213ca857-442d-46b1-945c-ac68b9d850df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1372458957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03bd8fc26dcc49b097ee0e27f9e3bb3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:17Z,use_quota=True,user_id='41d68fbea6f248869848605c13575194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c4759a-23de-4383-9d2d-2803442d5e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93c4759a-23de-4383-9d2d-2803442d5e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1bb0e3-cdb1-453c-b7ff-bdbeae025ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c1bb0e3-cdb1-453c-b7ff-bdbeae025ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94', 'volume_name': 'volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94', 'volume_size': 2}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7cf686f-140c-401a-9667-323720e5a727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7cf686f-140c-401a-9667-323720e5a727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52db902d-e871-4f62-99b3-1f2c5ff350bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:16 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Volume e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94', 'volume_size': 2} Sep 07 13:58:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:17 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-21abf20a-ba46-4e3a-a919-bd4194262778 1073741824" returned: 0 in 0.508s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-21abf20a-ba46-4e3a-a919-bd4194262778 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:17 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-21abf20a-ba46-4e3a-a919-bd4194262778 Sep 07 13:58:17 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:17 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-21abf20a-ba46-4e3a-a919-bd4194262778" returned: 0 in 0.294s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.709s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1372458957',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03bd8fc26dcc49b097ee0e27f9e3bb3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:17Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:17Z,use_quota=True,user_id='41d68fbea6f248869848605c13575194',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Creating volume e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:17 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 2147483648 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d830b4-7775-42af-a0f5-fa409db699fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21abf20a-ba46-4e3a-a919-bd4194262778', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c68500d-fe4d-4581-bb8d-1eb699a8e06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:17 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 2147483648 Sep 07 13:58:17 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:17 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Volume volume-21abf20a-ba46-4e3a-a919-bd4194262778 (21abf20a-ba46-4e3a-a919-bd4194262778): created successfully Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c68500d-fe4d-4581-bb8d-1eb699a8e06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Flow 'volume_create_manager' (2e333526-752c-4be6-b53a-7a14ba181e45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:17 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-72871576-47d3-48b7-9111-8a7f26e7c511 tempest-CinderUnicodeTest-1478308982 None] Created volume successfully. Sep 07 13:58:18 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 2147483648" returned: 0 in 0.629s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:18 devstack sudo[102305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 Sep 07 13:58:18 devstack sudo[102305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:18 devstack sudo[102305]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94" returned: 0 in 0.305s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52db902d-e871-4f62-99b3-1f2c5ff350bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94', 'volume_size': 2}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf0bbbd1-b860-420c-b61c-920ac77e7120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:18 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Volume volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 (e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94): created successfully Sep 07 13:58:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf0bbbd1-b860-420c-b61c-920ac77e7120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Flow 'volume_create_manager' (c13e6466-2609-4fa6-bbe9-89239811950c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-83d99986-9d9a-4289-a3c5-e009e99397b5 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Created volume successfully. Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Creating offline snapshot 99ac7598-60f9-4b89-813c-c2f6150da6d7 of volume e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4a07ad-8fbd-48cb-9ce0-b3f635d2a88d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:19 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 Sep 07 13:58:19 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Flow 'volume_create_manager' (6dd6f83c-0702-4ecc-b105-393b9d345407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae0b4aa-ddf7-43ed-b367-f6153aab6270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eae0b4aa-ddf7-43ed-b367-f6153aab6270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-714069514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c551435-63ec-46a1-a577-71c153c55799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='136b2ff5c9cd4a518d108a56286ff7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:19Z,use_quota=True,user_id='07b2a8dea1a548798ab2ffc9a4863661',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e60c3ce-1ac7-41dc-9f99-2150d65464aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e60c3ce-1ac7-41dc-9f99-2150d65464aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25daf12c-b9e8-468f-bf26-ab0c42e0fafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25daf12c-b9e8-468f-bf26-ab0c42e0fafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c551435-63ec-46a1-a577-71c153c55799', 'volume_name': 'volume-0c551435-63ec-46a1-a577-71c153c55799', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71daee5a-5a22-420d-a32d-952790173cb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71daee5a-5a22-420d-a32d-952790173cb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a9b8f5-ea76-4c3a-8d53-bf92638eae40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:19 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Volume 0c551435-63ec-46a1-a577-71c153c55799: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c551435-63ec-46a1-a577-71c153c55799', 'volume_size': 1} Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:19 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94" returned: 0 in 0.465s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7 2G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:19 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7 2G Sep 07 13:58:19 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:20 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7 2G" returned: 0 in 0.490s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:20 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7 Sep 07 13:58:20 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:20 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7" returned: 0 in 0.444s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:20 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7 is being set with open permissions: ugo+rw Sep 07 13:58:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:20 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7 Sep 07 13:58:20 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:20 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7" returned: 0 in 0.274s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:20 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.info Sep 07 13:58:20 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:21 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.info" returned: 0 in 0.285s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:21 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.info is being set with open permissions: ugo+rw Sep 07 13:58:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:21 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.info Sep 07 13:58:21 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:21 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.info" returned: 0 in 0.295s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.389s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.992s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:19Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-714069514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c551435-63ec-46a1-a577-71c153c55799,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='136b2ff5c9cd4a518d108a56286ff7cc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:19Z,use_quota=True,user_id='07b2a8dea1a548798ab2ffc9a4863661',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Creating volume 0c551435-63ec-46a1-a577-71c153c55799 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:21 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:58:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:21 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799 1073741824 Sep 07 13:58:21 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-69539238-154d-41de-98ff-ac67fde10ce8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Create snapshot completed successfully Sep 07 13:58:21 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799 1073741824" returned: 0 in 0.505s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:22 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799 Sep 07 13:58:22 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Acquiring lock "cinder-99ac7598-60f9-4b89-813c-c2f6150da6d7-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:22 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "cinder-99ac7598-60f9-4b89-813c-c2f6150da6d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Acquiring lock "cinder-quobyte-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799" returned: 0 in 0.308s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "cinder-quobyte-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Acquiring lock "cinder-quobyte-99ac7598-60f9-4b89-813c-c2f6150da6d7" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a9b8f5-ea76-4c3a-8d53-bf92638eae40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c551435-63ec-46a1-a577-71c153c55799', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c19ef3-4b95-45ac-b422-407edba3cedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "cinder-quobyte-99ac7598-60f9-4b89-813c-c2f6150da6d7" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Deleting offline snapshot 99ac7598-60f9-4b89-813c-c2f6150da6d7 of volume e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] snapshot_file for this snap is: volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:58:22 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Volume volume-0c551435-63ec-46a1-a577-71c153c55799 (0c551435-63ec-46a1-a577-71c153c55799): created successfully Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c19ef3-4b95-45ac-b422-407edba3cedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Flow 'volume_create_manager' (6dd6f83c-0702-4ecc-b105-393b9d345407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da4a98c-0bf4-413b-952c-f925fe17d8eb]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-43d4c245-405b-4748-89ba-c17b3920f8f4 tempest-CinderUnicodeTest-1478308982 None] Created volume successfully. Sep 07 13:58:22 devstack sudo[102342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7 Sep 07 13:58:22 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:22 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7" returned: 0 in 0.381s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3315a9-49de-4258-87b7-b0ea3a4b805d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:22 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 Sep 07 13:58:22 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:23 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94" returned: 0 in 0.390s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:23 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7 Sep 07 13:58:23 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:23 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7" returned: 0 in 0.424s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:23 devstack sudo[102359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7 Sep 07 13:58:23 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] Creating offline snapshot f1630790-b417-4343-bb76-02f65579af75 of volume 0c551435-63ec-46a1-a577-71c153c55799 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:58:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[372ef7e6-e512-4b18-b9d1-2201e6417a29]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:23 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94.99ac7598-60f9-4b89-813c-c2f6150da6d7" returned: 0 in 0.316s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:24 devstack sudo[102361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799 Sep 07 13:58:24 devstack sudo[102361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "cinder-quobyte-99ac7598-60f9-4b89-813c-c2f6150da6d7" released by "_delete_snapshot" :: held 1.662s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "cinder-quobyte-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94" released by "delete_snapshot" :: held 1.716s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:24 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Created reservations ['5e63af81-ea64-4d14-9584-8d24d1d7a49a', 'ebd5c5ae-4439-4426-be8f-490a66bf33f1', '7a4a7231-970a-4758-801e-433732fd8e4d', '7c98d710-d2f3-4835-bd64-dca46801c814'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Delete snapshot completed successfully. Sep 07 13:58:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8d48692d-e617-4746-895f-8f36857eebf8 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "cinder-99ac7598-60f9-4b89-813c-c2f6150da6d7-delete_snapshot" released by "delete_snapshot" :: held 1.887s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:24 devstack sudo[102361]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799" returned: 0 in 0.436s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:24 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75 1G Sep 07 13:58:24 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Acquiring lock "cinder-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "cinder-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Acquiring lock "cinder-quobyte-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "cinder-quobyte-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:24 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd95815d-73e3-42c2-bce9-529fc7a2d478]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:24 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 Sep 07 13:58:24 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:24 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75 1G" returned: 0 in 0.479s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c551435-63ec-46a1-a577-71c153c55799 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:24 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c551435-63ec-46a1-a577-71c153c55799 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75 Sep 07 13:58:24 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:25 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94" returned: 0 in 0.464s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:25 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94 Sep 07 13:58:25 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:25 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c551435-63ec-46a1-a577-71c153c55799 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75" returned: 0 in 0.379s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:25 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75 is being set with open permissions: ugo+rw Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:25 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75 Sep 07 13:58:25 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:25 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94" returned: 0 in 0.312s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "cinder-quobyte-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94" released by "delete_volume" :: held 0.841s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:25 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75" returned: 0 in 0.272s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Created reservations ['18bbf903-324b-4972-9396-42f91a9d2867', '7954a4e0-9a80-4003-8775-a99b86f959ea', 'd2d152c9-9b47-4ee4-bc66-e7423fb167b1', 'baf53c6d-dbfa-4d40-a937-73d9b3557efc'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:25 devstack sudo[102388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.info Sep 07 13:58:25 devstack sudo[102388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:25 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:58:25 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:25 devstack sudo[102388]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.info" returned: 0 in 0.302s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:25 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.info is being set with open permissions: ugo+rw Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:25 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.info Sep 07 13:58:25 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:25 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.370s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:25 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Deleted volume successfully. Sep 07 13:58:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dc7dcf88-b62f-443f-9ecc-effec1307b30 tempest-VolumesSnapshotNegativeTestJSON-1954635391 None] Lock "cinder-e4fa7fd1-9a71-49f9-9459-fbcd61b2fc94-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:26 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.info" returned: 0 in 0.338s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.329s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cad9709a-2e0e-483b-89da-04fc7826fa70 tempest-CinderUnicodeTest-1478308982 None] Create snapshot completed successfully Sep 07 13:58:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Acquiring lock "cinder-f1630790-b417-4343-bb76-02f65579af75-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Lock "cinder-f1630790-b417-4343-bb76-02f65579af75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Acquiring lock "cinder-quobyte-0c551435-63ec-46a1-a577-71c153c55799" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Lock "cinder-quobyte-0c551435-63ec-46a1-a577-71c153c55799" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Acquiring lock "cinder-quobyte-f1630790-b417-4343-bb76-02f65579af75" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Lock "cinder-quobyte-f1630790-b417-4343-bb76-02f65579af75" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Deleting offline snapshot f1630790-b417-4343-bb76-02f65579af75 of volume 0c551435-63ec-46a1-a577-71c153c55799 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:58:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] snapshot_file for this snap is: volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:58:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d52f34-7d43-4ed0-986d-e3f4abc8a591]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:27 devstack sudo[102397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75 Sep 07 13:58:27 devstack sudo[102397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:27 devstack sudo[102397]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75" returned: 0 in 0.441s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c551435-63ec-46a1-a577-71c153c55799(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:58:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[365d31ba-1047-402e-80cb-04398e821135]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:27 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799 Sep 07 13:58:27 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:28 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799" returned: 0 in 0.424s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:28 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75 Sep 07 13:58:28 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:28 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75" returned: 0 in 0.454s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:28 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75 Sep 07 13:58:28 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:28 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799.f1630790-b417-4343-bb76-02f65579af75" returned: 0 in 0.267s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Lock "cinder-quobyte-f1630790-b417-4343-bb76-02f65579af75" released by "_delete_snapshot" :: held 1.727s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Lock "cinder-quobyte-0c551435-63ec-46a1-a577-71c153c55799" released by "delete_snapshot" :: held 1.766s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:28 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Created reservations ['3c826f4f-b35c-4aad-9f85-8f74b77d32b0', '2456857b-b129-4fbb-9000-6c6b0c52731e', 'fe9c156c-9483-42e6-86cb-6c90579664db', 'c9692e22-7fe7-4557-bb18-3012afb66557'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Delete snapshot completed successfully. Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5b4e69de-a81a-428f-95ea-243ed6236f12 tempest-CinderUnicodeTest-1478308982 None] Lock "cinder-f1630790-b417-4343-bb76-02f65579af75-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Acquiring lock "cinder-0c551435-63ec-46a1-a577-71c153c55799-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Lock "cinder-0c551435-63ec-46a1-a577-71c153c55799-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Acquiring lock "cinder-quobyte-0c551435-63ec-46a1-a577-71c153c55799" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Lock "cinder-quobyte-0c551435-63ec-46a1-a577-71c153c55799" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e827a3f-cbc8-4577-ba8f-8a681deb53b8]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:58:29 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799 Sep 07 13:58:29 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Flow 'volume_create_manager' (4e14449f-be03-4d14-a50f-4b82cfec37d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b07168e-0241-4e4f-82b6-4b23d5a59207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b07168e-0241-4e4f-82b6-4b23d5a59207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1118161448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a6630f-aa3f-46ac-869b-c2131cf60945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82910d8fc5804d80a2dd45ad5cfa908d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:30Z,use_quota=True,user_id='685326704b7847dba4fe1be98db9e111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0920a58e-2798-44dd-bdfa-7b603ef9611d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0920a58e-2798-44dd-bdfa-7b603ef9611d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65c6cb5-c48e-4ae1-a465-10e76b54b1ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f65c6cb5-c48e-4ae1-a465-10e76b54b1ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5a6630f-aa3f-46ac-869b-c2131cf60945', 'volume_name': 'volume-c5a6630f-aa3f-46ac-869b-c2131cf60945', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1980fdbf-a59e-4183-bbb3-d54aa2ab02aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1980fdbf-a59e-4183-bbb3-d54aa2ab02aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd76f35-0175-4380-8248-61cbd9460d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:29 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Volume c5a6630f-aa3f-46ac-869b-c2131cf60945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5a6630f-aa3f-46ac-869b-c2131cf60945', 'volume_size': 1} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1118161448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5a6630f-aa3f-46ac-869b-c2131cf60945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82910d8fc5804d80a2dd45ad5cfa908d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:30Z,use_quota=True,user_id='685326704b7847dba4fe1be98db9e111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Creating volume c5a6630f-aa3f-46ac-869b-c2131cf60945 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:29 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c5a6630f-aa3f-46ac-869b-c2131cf60945 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:29 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c5a6630f-aa3f-46ac-869b-c2131cf60945 1073741824 Sep 07 13:58:29 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:29 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:58:29 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:30 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799" returned: 0 in 0.606s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:30 devstack sudo[102424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799 Sep 07 13:58:30 devstack sudo[102424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:30 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.555s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 29 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:58:30 devstack sudo[102424]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c551435-63ec-46a1-a577-71c153c55799" returned: 0 in 0.363s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Flow 'volume_create_manager' (cf3c747f-e3f1-4e19-9e71-ae7dc73da6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c56936b-d999-4971-aa01-23f303701df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Lock "cinder-quobyte-0c551435-63ec-46a1-a577-71c153c55799" released by "delete_volume" :: held 1.158s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c56936b-d999-4971-aa01-23f303701df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1093387785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727bfbb2-9337-4e3c-9bd2-f3231b661704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82910d8fc5804d80a2dd45ad5cfa908d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:30Z,use_quota=True,user_id='685326704b7847dba4fe1be98db9e111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81baf91a-a011-4e69-a086-e42b998d0430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81baf91a-a011-4e69-a086-e42b998d0430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f46cc7b-d316-4983-86ed-2a5b328b51a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f46cc7b-d316-4983-86ed-2a5b328b51a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '727bfbb2-9337-4e3c-9bd2-f3231b661704', 'volume_name': 'volume-727bfbb2-9337-4e3c-9bd2-f3231b661704', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbbf0643-80fd-4b76-a3fd-6c3e4adbc324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbbf0643-80fd-4b76-a3fd-6c3e4adbc324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df26ec2-b41b-487d-8c28-5b904d82ad12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:30 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Volume 727bfbb2-9337-4e3c-9bd2-f3231b661704: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-727bfbb2-9337-4e3c-9bd2-f3231b661704', 'volume_size': 1} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:30 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c5a6630f-aa3f-46ac-869b-c2131cf60945 1073741824" returned: 0 in 0.912s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Created reservations ['81e9b1df-9292-4c52-9549-202fd48678b3', '10814696-7ebe-4a7d-bb11-257d2fbd045a', '528eb7d7-3bc4-4a94-b44b-2109c14250f8', 'f1b21808-664f-41a6-b1e0-7cd9f94315d4'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c5a6630f-aa3f-46ac-869b-c2131cf60945 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:30 devstack sudo[102432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c5a6630f-aa3f-46ac-869b-c2131cf60945 Sep 07 13:58:30 devstack sudo[102432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:30 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:58:30 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Flow 'volume_create_manager' (f24bf48f-5155-46aa-8974-95e24c1f288c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26bb2007-384f-474a-8f04-cb6a42eeaa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26bb2007-384f-474a-8f04-cb6a42eeaa7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1739527171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354b1c23-9cf9-4f7a-b65d-4ace1b011d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82910d8fc5804d80a2dd45ad5cfa908d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:31Z,use_quota=True,user_id='685326704b7847dba4fe1be98db9e111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363472e5-6a28-4b88-9d06-71b199481243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (363472e5-6a28-4b88-9d06-71b199481243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99528eb0-daa2-44fd-a004-f2a9057997da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99528eb0-daa2-44fd-a004-f2a9057997da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '354b1c23-9cf9-4f7a-b65d-4ace1b011d67', 'volume_name': 'volume-354b1c23-9cf9-4f7a-b65d-4ace1b011d67', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c924333d-99dc-4cb5-858d-44f93660167e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c924333d-99dc-4cb5-858d-44f93660167e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3db083-5c6c-494e-bcb8-023fac0607d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:31 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Volume 354b1c23-9cf9-4f7a-b65d-4ace1b011d67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-354b1c23-9cf9-4f7a-b65d-4ace1b011d67', 'volume_size': 1} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:31 devstack sudo[102432]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c5a6630f-aa3f-46ac-869b-c2131cf60945" returned: 0 in 0.448s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] <== create_volume: return (1429ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.434s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.569s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1093387785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727bfbb2-9337-4e3c-9bd2-f3231b661704,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82910d8fc5804d80a2dd45ad5cfa908d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:30Z,use_quota=True,user_id='685326704b7847dba4fe1be98db9e111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Creating volume 727bfbb2-9337-4e3c-9bd2-f3231b661704 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:31 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-727bfbb2-9337-4e3c-9bd2-f3231b661704 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:31 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:31 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-727bfbb2-9337-4e3c-9bd2-f3231b661704 1073741824 Sep 07 13:58:31 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bd76f35-0175-4380-8248-61cbd9460d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a6630f-aa3f-46ac-869b-c2131cf60945', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54a0194-6116-48c4-9e31-2294396526c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.425s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Deleted volume successfully. Sep 07 13:58:31 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Volume volume-c5a6630f-aa3f-46ac-869b-c2131cf60945 (c5a6630f-aa3f-46ac-869b-c2131cf60945): created successfully Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a54a0194-6116-48c4-9e31-2294396526c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Flow 'volume_create_manager' (4e14449f-be03-4d14-a50f-4b82cfec37d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-80806a95-6650-48f1-9226-901c6d749fd1 tempest-CinderUnicodeTest-1478308982 None] Lock "cinder-0c551435-63ec-46a1-a577-71c153c55799-delete_volume" released by "delete_volume" :: held 2.063s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-53238ff0-3889-48c5-b7fa-e9871297ebab tempest-CreateVolumesFromImageTest-580221916 None] Created volume successfully. Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Flow 'volume_create_manager' (8992dbfe-a84a-4b19-9870-de5d2f6a1cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cad8fa-4cae-4b11-a26b-7d950532ec92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71cad8fa-4cae-4b11-a26b-7d950532ec92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1288279377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2714bcce-95a2-44ee-92ee-b02c1280bbbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82910d8fc5804d80a2dd45ad5cfa908d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:32Z,use_quota=True,user_id='685326704b7847dba4fe1be98db9e111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203cff71-f392-408d-a622-4b329798a29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (203cff71-f392-408d-a622-4b329798a29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b50720-aa2e-49e6-a6e7-79cecee31a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b50720-aa2e-49e6-a6e7-79cecee31a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2714bcce-95a2-44ee-92ee-b02c1280bbbe', 'volume_name': 'volume-2714bcce-95a2-44ee-92ee-b02c1280bbbe', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4796ce-205b-437e-807f-ae6a570de7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc4796ce-205b-437e-807f-ae6a570de7d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3b4e86-fa3f-44df-8d70-1a0a3e948b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:31 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Volume 2714bcce-95a2-44ee-92ee-b02c1280bbbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2714bcce-95a2-44ee-92ee-b02c1280bbbe', 'volume_size': 1} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Acquiring lock "cinder-21abf20a-ba46-4e3a-a919-bd4194262778-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Lock "cinder-21abf20a-ba46-4e3a-a919-bd4194262778-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Acquiring lock "cinder-quobyte-21abf20a-ba46-4e3a-a919-bd4194262778" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Lock "cinder-quobyte-21abf20a-ba46-4e3a-a919-bd4194262778" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d784d184-6efb-490b-a9f1-c9f1bcdc4291]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-21abf20a-ba46-4e3a-a919-bd4194262778 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:31 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-727bfbb2-9337-4e3c-9bd2-f3231b661704 1073741824" returned: 0 in 0.695s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-727bfbb2-9337-4e3c-9bd2-f3231b661704 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:32 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-727bfbb2-9337-4e3c-9bd2-f3231b661704 Sep 07 13:58:32 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:32 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-21abf20a-ba46-4e3a-a919-bd4194262778 Sep 07 13:58:32 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:58:32 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Flow 'volume_create_manager' (8f593556-6e93-4b69-9105-2a720cabe7be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7943e889-cf48-461f-8f9f-b235e049c451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-727bfbb2-9337-4e3c-9bd2-f3231b661704" returned: 0 in 0.370s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.193s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1739527171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=354b1c23-9cf9-4f7a-b65d-4ace1b011d67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82910d8fc5804d80a2dd45ad5cfa908d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:31Z,use_quota=True,user_id='685326704b7847dba4fe1be98db9e111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Creating volume 354b1c23-9cf9-4f7a-b65d-4ace1b011d67 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:32 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-354b1c23-9cf9-4f7a-b65d-4ace1b011d67 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:32 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7943e889-cf48-461f-8f9f-b235e049c451) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-722298452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dce9076-04ce-422f-97bd-fef487c0412e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82910d8fc5804d80a2dd45ad5cfa908d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:32Z,use_quota=True,user_id='685326704b7847dba4fe1be98db9e111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d428ce7-1d0c-4945-a0cd-3d2c309839c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:32 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-354b1c23-9cf9-4f7a-b65d-4ace1b011d67 1073741824 Sep 07 13:58:32 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d428ce7-1d0c-4945-a0cd-3d2c309839c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6389b478-aece-4334-bd17-6cd6cfb7c719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6389b478-aece-4334-bd17-6cd6cfb7c719) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dce9076-04ce-422f-97bd-fef487c0412e', 'volume_name': 'volume-5dce9076-04ce-422f-97bd-fef487c0412e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1f109e-06c0-4cda-99e9-1c173918bc2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a1f109e-06c0-4cda-99e9-1c173918bc2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c343922-bce8-42d3-b334-26304e3cd62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:32 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Volume 5dce9076-04ce-422f-97bd-fef487c0412e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dce9076-04ce-422f-97bd-fef487c0412e', 'volume_size': 1} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-21abf20a-ba46-4e3a-a919-bd4194262778" returned: 0 in 0.556s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-21abf20a-ba46-4e3a-a919-bd4194262778 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5df26ec2-b41b-487d-8c28-5b904d82ad12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-727bfbb2-9337-4e3c-9bd2-f3231b661704', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4d4075-00aa-4560-91f4-70f7589cb440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:32 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Volume volume-727bfbb2-9337-4e3c-9bd2-f3231b661704 (727bfbb2-9337-4e3c-9bd2-f3231b661704): created successfully Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd4d4075-00aa-4560-91f4-70f7589cb440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:32 devstack sudo[102453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-21abf20a-ba46-4e3a-a919-bd4194262778 Sep 07 13:58:32 devstack sudo[102453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Flow 'volume_create_manager' (cf3c747f-e3f1-4e19-9e71-ae7dc73da6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:32 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ddab4f2b-2d12-40f7-b9ab-a6899be8c721 tempest-CreateVolumesFromImageTest-580221916 None] Created volume successfully. Sep 07 13:58:32 devstack sudo[102453]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-21abf20a-ba46-4e3a-a919-bd4194262778" returned: 0 in 0.336s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Lock "cinder-quobyte-21abf20a-ba46-4e3a-a919-bd4194262778" released by "delete_volume" :: held 0.962s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Created reservations ['3ef2fb94-8dd4-4754-b9a5-42f225a3ddca', '4c71e28c-826b-446f-87ec-df641e440a29', 'cd7af14b-20f7-4629-b98e-cbb16714de4f', 'ae02f78b-fcb6-4b61-bc51-5d70df946eb6'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:32 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-354b1c23-9cf9-4f7a-b65d-4ace1b011d67 1073741824" returned: 0 in 0.608s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:33 devstack sudo[102461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:58:33 devstack sudo[102461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-354b1c23-9cf9-4f7a-b65d-4ace1b011d67 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:33 devstack sudo[102463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-354b1c23-9cf9-4f7a-b65d-4ace1b011d67 Sep 07 13:58:33 devstack sudo[102463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:33 devstack sudo[102461]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.338s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Deleted volume successfully. Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-396a31d1-01ec-4eef-a726-1f1b347647ee tempest-CinderUnicodeTest-1478308982 None] Lock "cinder-21abf20a-ba46-4e3a-a919-bd4194262778-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:33 devstack sudo[102463]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-354b1c23-9cf9-4f7a-b65d-4ace1b011d67" returned: 0 in 0.385s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.720s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1288279377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2714bcce-95a2-44ee-92ee-b02c1280bbbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82910d8fc5804d80a2dd45ad5cfa908d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:32Z,use_quota=True,user_id='685326704b7847dba4fe1be98db9e111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Creating volume 2714bcce-95a2-44ee-92ee-b02c1280bbbe {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:33 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2714bcce-95a2-44ee-92ee-b02c1280bbbe 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d3db083-5c6c-494e-bcb8-023fac0607d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-354b1c23-9cf9-4f7a-b65d-4ace1b011d67', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:33 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2714bcce-95a2-44ee-92ee-b02c1280bbbe 1073741824 Sep 07 13:58:33 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad430344-63bb-4797-a703-99b39a5d4bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:33 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Volume volume-354b1c23-9cf9-4f7a-b65d-4ace1b011d67 (354b1c23-9cf9-4f7a-b65d-4ace1b011d67): created successfully Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad430344-63bb-4797-a703-99b39a5d4bee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Flow 'volume_create_manager' (f24bf48f-5155-46aa-8974-95e24c1f288c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b00f2a97-979e-481c-a438-85dc18b39ed5 tempest-CreateVolumesFromImageTest-580221916 None] Created volume successfully. Sep 07 13:58:33 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2714bcce-95a2-44ee-92ee-b02c1280bbbe 1073741824" returned: 0 in 0.518s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2714bcce-95a2-44ee-92ee-b02c1280bbbe {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:34 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2714bcce-95a2-44ee-92ee-b02c1280bbbe Sep 07 13:58:34 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:34 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2714bcce-95a2-44ee-92ee-b02c1280bbbe" returned: 0 in 0.355s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.975s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-722298452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dce9076-04ce-422f-97bd-fef487c0412e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82910d8fc5804d80a2dd45ad5cfa908d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:32Z,use_quota=True,user_id='685326704b7847dba4fe1be98db9e111',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Creating volume 5dce9076-04ce-422f-97bd-fef487c0412e {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:34 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5dce9076-04ce-422f-97bd-fef487c0412e 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed3b4e86-fa3f-44df-8d70-1a0a3e948b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2714bcce-95a2-44ee-92ee-b02c1280bbbe', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:34 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5dce9076-04ce-422f-97bd-fef487c0412e 1073741824 Sep 07 13:58:34 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe18fb5-b39f-47fa-a433-4418f622a4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:34 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Volume volume-2714bcce-95a2-44ee-92ee-b02c1280bbbe (2714bcce-95a2-44ee-92ee-b02c1280bbbe): created successfully Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fe18fb5-b39f-47fa-a433-4418f622a4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Flow 'volume_create_manager' (8992dbfe-a84a-4b19-9870-de5d2f6a1cc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:34 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-92c7ba9a-9173-4fa4-b8f2-34721646f3a0 tempest-CreateVolumesFromImageTest-580221916 None] Created volume successfully. Sep 07 13:58:35 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5dce9076-04ce-422f-97bd-fef487c0412e 1073741824" returned: 0 in 0.661s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5dce9076-04ce-422f-97bd-fef487c0412e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:35 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5dce9076-04ce-422f-97bd-fef487c0412e Sep 07 13:58:35 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:35 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5dce9076-04ce-422f-97bd-fef487c0412e" returned: 0 in 0.320s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c343922-bce8-42d3-b334-26304e3cd62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dce9076-04ce-422f-97bd-fef487c0412e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da4bcfc-544e-425b-a42d-e1df3158cdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:35 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Volume volume-5dce9076-04ce-422f-97bd-fef487c0412e (5dce9076-04ce-422f-97bd-fef487c0412e): created successfully Sep 07 13:58:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da4bcfc-544e-425b-a42d-e1df3158cdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Flow 'volume_create_manager' (8f593556-6e93-4b69-9105-2a720cabe7be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:35 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-af718120-db99-42ab-b380-fa9ae97af7b7 tempest-CreateVolumesFromImageTest-580221916 None] Created volume successfully. Sep 07 13:58:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "cinder-5dce9076-04ce-422f-97bd-fef487c0412e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-5dce9076-04ce-422f-97bd-fef487c0412e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "cinder-quobyte-5dce9076-04ce-422f-97bd-fef487c0412e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-quobyte-5dce9076-04ce-422f-97bd-fef487c0412e" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:36 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e7e3ce-7e3b-4cb6-bb98-de2203c2cbf1]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5dce9076-04ce-422f-97bd-fef487c0412e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:36 devstack sudo[102485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5dce9076-04ce-422f-97bd-fef487c0412e Sep 07 13:58:36 devstack sudo[102485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:36 devstack sudo[102485]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5dce9076-04ce-422f-97bd-fef487c0412e" returned: 0 in 0.431s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5dce9076-04ce-422f-97bd-fef487c0412e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:36 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5dce9076-04ce-422f-97bd-fef487c0412e Sep 07 13:58:36 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:36 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5dce9076-04ce-422f-97bd-fef487c0412e" returned: 0 in 0.299s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-quobyte-5dce9076-04ce-422f-97bd-fef487c0412e" released by "delete_volume" :: held 0.783s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:36 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Created reservations ['ffd22d37-cb7b-4e1f-8fa8-d8cc8348d52a', '1b60bb1b-eb97-4293-8654-47ca0ed9350e', 'd772a0c0-394e-4be3-9573-6c2f76e0bdee', '57a8a46a-31e5-4afc-a216-a49c19c49224'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:36 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:58:36 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "cinder-2714bcce-95a2-44ee-92ee-b02c1280bbbe-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-2714bcce-95a2-44ee-92ee-b02c1280bbbe-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "cinder-quobyte-2714bcce-95a2-44ee-92ee-b02c1280bbbe" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-quobyte-2714bcce-95a2-44ee-92ee-b02c1280bbbe" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:37 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d221c2a0-d54c-486b-b9b4-c7afc0d971e4]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2714bcce-95a2-44ee-92ee-b02c1280bbbe {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:37 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.401s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:37 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Deleted volume successfully. Sep 07 13:58:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-50871f2f-3d74-4cee-9a22-94914653ca82 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-5dce9076-04ce-422f-97bd-fef487c0412e-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:37 devstack sudo[102497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2714bcce-95a2-44ee-92ee-b02c1280bbbe Sep 07 13:58:37 devstack sudo[102497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:37 devstack sudo[102497]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2714bcce-95a2-44ee-92ee-b02c1280bbbe" returned: 0 in 0.423s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2714bcce-95a2-44ee-92ee-b02c1280bbbe {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:37 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2714bcce-95a2-44ee-92ee-b02c1280bbbe Sep 07 13:58:37 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:38 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2714bcce-95a2-44ee-92ee-b02c1280bbbe" returned: 0 in 0.300s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-quobyte-2714bcce-95a2-44ee-92ee-b02c1280bbbe" released by "delete_volume" :: held 0.784s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Created reservations ['42a1a4be-29cc-4e3c-80b7-03cb5cba5821', 'f92537d4-8241-414f-9171-ae2b92d97b4a', '6640dfda-c471-40bf-9a8e-1c73d0e1693e', '3d621342-c75f-4df4-8130-8da832ef3f35'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:38 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:58:38 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "cinder-354b1c23-9cf9-4f7a-b65d-4ace1b011d67-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-354b1c23-9cf9-4f7a-b65d-4ace1b011d67-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "cinder-quobyte-354b1c23-9cf9-4f7a-b65d-4ace1b011d67" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-quobyte-354b1c23-9cf9-4f7a-b65d-4ace1b011d67" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c596820-c655-48e7-bdad-619dbce7bb9c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-354b1c23-9cf9-4f7a-b65d-4ace1b011d67 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:38 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.363s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:38 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Deleted volume successfully. Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-378fee72-510a-49f2-a9d5-b128a6ef9714 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-2714bcce-95a2-44ee-92ee-b02c1280bbbe-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:38 devstack sudo[102509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-354b1c23-9cf9-4f7a-b65d-4ace1b011d67 Sep 07 13:58:38 devstack sudo[102509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:38 devstack sudo[102509]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-354b1c23-9cf9-4f7a-b65d-4ace1b011d67" returned: 0 in 0.463s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-354b1c23-9cf9-4f7a-b65d-4ace1b011d67 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:39 devstack sudo[102514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-354b1c23-9cf9-4f7a-b65d-4ace1b011d67 Sep 07 13:58:39 devstack sudo[102514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:39 devstack sudo[102514]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-354b1c23-9cf9-4f7a-b65d-4ace1b011d67" returned: 0 in 0.327s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-quobyte-354b1c23-9cf9-4f7a-b65d-4ace1b011d67" released by "delete_volume" :: held 0.859s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Flow 'volume_create_manager' (6f88a2c1-8304-4c44-82eb-f71d1649be27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6b99c8-77e5-41c0-a72e-7e7fca4a6aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a6b99c8-77e5-41c0-a72e-7e7fca4a6aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1774073209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594cd4ea-2c86-4511-87df-8b8213a82ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbd239d9ea040b9b7d976a745910f53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:39Z,use_quota=True,user_id='07b2ee54ec034354a407ebb1bfb6d61a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189c3e2d-e538-4821-a841-6db72a0a17f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (189c3e2d-e538-4821-a841-6db72a0a17f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd816fc-0a7f-4e0d-8237-2d33fd708e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Created reservations ['77d43e5e-917f-406f-b62a-b0299bf51c1b', '90ac4a0b-99ec-4d22-a84b-a5e589dc48a7', '2c1a636c-1926-499b-b239-4c9cc664a824', '50ef35a9-3af4-41ba-8823-ce1fff91db5f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:39 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:58:39 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:39 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.291s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:39 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Deleted volume successfully. Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffd816fc-0a7f-4e0d-8237-2d33fd708e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '594cd4ea-2c86-4511-87df-8b8213a82ef4', 'volume_name': 'volume-594cd4ea-2c86-4511-87df-8b8213a82ef4', 'volume_size': 1, 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e02e283d554267ad4387462fa3cb7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'created_at': datetime.datetime(2026, 9, 7, 11, 36, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09f2352e-bb3e-4924-9aca-b02c5284d704/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52f93b7-042c-4517-9b20-e183aa07a8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b52f93b7-042c-4517-9b20-e183aa07a8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2854fc7-9f2d-4e06-a1d6-d45386e8b493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:39 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Volume 594cd4ea-2c86-4511-87df-8b8213a82ef4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-594cd4ea-2c86-4511-87df-8b8213a82ef4', 'volume_size': 1, 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e02e283d554267ad4387462fa3cb7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'created_at': datetime.datetime(2026, 9, 7, 11, 36, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09f2352e-bb3e-4924-9aca-b02c5284d704/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Trying to clone 594cd4ea-2c86-4511-87df-8b8213a82ef4 from image 09f2352e-bb3e-4924-9aca-b02c5284d704 at location (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 13:58:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e9b404b1-7b66-4c6f-985c-189d39117c25 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-354b1c23-9cf9-4f7a-b65d-4ace1b011d67-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:40 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_64qe9gdfdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 13:58:40 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Image download 20.69 MB at 20.69 MB/s Sep 07 13:58:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a52e43-8a44-4506-b4dc-147c25a27c73]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_64qe9gdfdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:40 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_64qe9gdfdevstack@QuobyteHD Sep 07 13:58:40 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "cinder-727bfbb2-9337-4e3c-9bd2-f3231b661704-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-727bfbb2-9337-4e3c-9bd2-f3231b661704-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "cinder-quobyte-727bfbb2-9337-4e3c-9bd2-f3231b661704" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-quobyte-727bfbb2-9337-4e3c-9bd2-f3231b661704" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4948ce94-d184-45d4-b08a-027f41620e5a]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-727bfbb2-9337-4e3c-9bd2-f3231b661704 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:40 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_64qe9gdfdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:40 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Temporary image 09f2352e-bb3e-4924-9aca-b02c5284d704 is fetched for user 07b2ee54ec034354a407ebb1bfb6d61a. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 13:58:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6d0b15-4494-4e6c-b769-426e01673a4b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_64qe9gdfdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:40 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-727bfbb2-9337-4e3c-9bd2-f3231b661704 Sep 07 13:58:40 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:40 devstack sudo[102530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_64qe9gdfdevstack@QuobyteHD Sep 07 13:58:40 devstack sudo[102530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:41 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-727bfbb2-9337-4e3c-9bd2-f3231b661704" returned: 0 in 0.422s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-727bfbb2-9337-4e3c-9bd2-f3231b661704 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:41 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-727bfbb2-9337-4e3c-9bd2-f3231b661704 Sep 07 13:58:41 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:41 devstack sudo[102530]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_64qe9gdfdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1774073209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=594cd4ea-2c86-4511-87df-8b8213a82ef4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8bbd239d9ea040b9b7d976a745910f53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:39Z,use_quota=True,user_id='07b2ee54ec034354a407ebb1bfb6d61a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Creating volume 594cd4ea-2c86-4511-87df-8b8213a82ef4 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:41 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:41 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4 1073741824 Sep 07 13:58:41 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:41 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-727bfbb2-9337-4e3c-9bd2-f3231b661704" returned: 0 in 0.293s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-quobyte-727bfbb2-9337-4e3c-9bd2-f3231b661704" released by "delete_volume" :: held 0.774s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Created reservations ['43858453-9823-4351-98bb-96b5b50a51c2', 'a3690d42-a3f1-4c9c-b446-e7ecd616d38e', '1e8ba84f-d027-4d14-9c83-e79f7706318f', 'baba262b-b52a-44d2-ab35-b0125d26007f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:41 devstack sudo[102548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:58:41 devstack sudo[102548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "cinder-c5a6630f-aa3f-46ac-869b-c2131cf60945-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:41 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4 1073741824" returned: 0 in 0.584s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-c5a6630f-aa3f-46ac-869b-c2131cf60945-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "cinder-quobyte-c5a6630f-aa3f-46ac-869b-c2131cf60945" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:41 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4 Sep 07 13:58:41 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-quobyte-c5a6630f-aa3f-46ac-869b-c2131cf60945" acquired by "delete_volume" :: waited 0.033s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:41 devstack sudo[102548]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.357s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:41 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Deleted volume successfully. Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf4c752c-ee5b-4320-b5b4-82fae7ba9799]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c5a6630f-aa3f-46ac-869b-c2131cf60945 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e01c2056-427a-40cd-8d04-a74ff82101a7 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-727bfbb2-9337-4e3c-9bd2-f3231b661704-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:42 devstack sudo[102553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c5a6630f-aa3f-46ac-869b-c2131cf60945 Sep 07 13:58:42 devstack sudo[102553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:42 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4" returned: 0 in 0.302s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Attempting download of 09f2352e-bb3e-4924-9aca-b02c5284d704 ((None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}])) to volume 594cd4ea-2c86-4511-87df-8b8213a82ef4. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a1a046-b5ce-4da8-bd77-4acae983758d]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704__9a99wko {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:42 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704__9a99wko Sep 07 13:58:42 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:42 devstack sudo[102553]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c5a6630f-aa3f-46ac-869b-c2131cf60945" returned: 0 in 0.445s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c5a6630f-aa3f-46ac-869b-c2131cf60945 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:42 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c5a6630f-aa3f-46ac-869b-c2131cf60945 Sep 07 13:58:42 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:42 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704__9a99wko" returned: 0 in 0.392s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704__9a99wko {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:42 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c5a6630f-aa3f-46ac-869b-c2131cf60945" returned: 0 in 0.290s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-quobyte-c5a6630f-aa3f-46ac-869b-c2131cf60945" released by "delete_volume" :: held 0.798s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Created reservations ['2bd212da-53da-40af-af05-6057521b68f2', '8e044f4f-681b-43bd-9db4-a059736db1c4', 'cea1eeab-d2ab-4acf-8a00-22af170c6181', 'cbdee5f0-828a-4270-a310-0dda5bc9ef9b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:42 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704__9a99wko Sep 07 13:58:42 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:42 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:58:42 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:43 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704__9a99wko" returned: 1 in 0.435s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_09f2352e-bb3e-4924-9aca-b02c5284d704__9a99wko' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:58:43 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e353b674-f32f-4f76-a786-bb385dacf649]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_64qe9gdfdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:43 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.286s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:43 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Deleted volume successfully. Sep 07 13:58:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0aec185a-69fc-4145-845d-c016c206b6b9 tempest-CreateVolumesFromImageTest-580221916 None] Lock "cinder-c5a6630f-aa3f-46ac-869b-c2131cf60945-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:43 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_64qe9gdfdevstack@QuobyteHD Sep 07 13:58:43 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:43 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_64qe9gdfdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:43 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] 09f2352e-bb3e-4924-9aca-b02c5284d704 was qcow2, converting to qcow2 {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 13:58:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_64qe9gdfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:43 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_64qe9gdfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4 Sep 07 13:58:43 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:45 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_64qe9gdfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4" returned: 0 in 2.116s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:45 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_09f2352e-bb3e-4924-9aca-b02c5284d704_64qe9gdfdevstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:58:45 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Converted 112.00 MB image at 52.89 MB/s Sep 07 13:58:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:45 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4 1G Sep 07 13:58:45 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:46 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4 1G" returned: 0 in 0.367s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Downloaded image 09f2352e-bb3e-4924-9aca-b02c5284d704 ((None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}])) to volume 594cd4ea-2c86-4511-87df-8b8213a82ef4 successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Temporary image 09f2352e-bb3e-4924-9aca-b02c5284d704 for user 07b2ee54ec034354a407ebb1bfb6d61a is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Marking volume 594cd4ea-2c86-4511-87df-8b8213a82ef4 as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Copying metadata from image 09f2352e-bb3e-4924-9aca-b02c5284d704 to 594cd4ea-2c86-4511-87df-8b8213a82ef4. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Creating volume glance metadata for volume 594cd4ea-2c86-4511-87df-8b8213a82ef4 backed by image 09f2352e-bb3e-4924-9aca-b02c5284d704 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2854fc7-9f2d-4e06-a1d6-d45386e8b493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-594cd4ea-2c86-4511-87df-8b8213a82ef4', 'volume_size': 1, 'image_id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/09f2352e-bb3e-4924-9aca-b02c5284d704', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '12e02e283d554267ad4387462fa3cb7f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '09f2352e-bb3e-4924-9aca-b02c5284d704', 'created_at': datetime.datetime(2026, 9, 7, 11, 36, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 36, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/09f2352e-bb3e-4924-9aca-b02c5284d704/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385533a4-e07a-4381-a624-58cbbbede483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:46 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Volume volume-594cd4ea-2c86-4511-87df-8b8213a82ef4 (594cd4ea-2c86-4511-87df-8b8213a82ef4): created successfully Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385533a4-e07a-4381-a624-58cbbbede483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Flow 'volume_create_manager' (6f88a2c1-8304-4c44-82eb-f71d1649be27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:46 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6762b54b-e031-4efe-9466-b71780e26721 tempest-TestShelveInstance-1006575646 None] Created volume successfully. Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Flow 'volume_create_manager' (71c25954-096b-4634-8c92-7d95836b3ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe36c55-fe9f-4797-af21-6e11c04cd8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfe36c55-fe9f-4797-af21-6e11c04cd8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-596384503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a275e4e2-057e-44e6-a6d2-83f3049fc2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ccdb34fbcbb4a66b3620213de1fa1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:47Z,use_quota=True,user_id='fd6219729ad54de0930c9d4a98cb4f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bdacc7e-756e-4758-b250-92cb50cc5eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bdacc7e-756e-4758-b250-92cb50cc5eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33cb647-2adf-4d2b-af7a-8d227204c09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e33cb647-2adf-4d2b-af7a-8d227204c09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a275e4e2-057e-44e6-a6d2-83f3049fc2d5', 'volume_name': 'volume-a275e4e2-057e-44e6-a6d2-83f3049fc2d5', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7859ae-4185-4cb6-820c-64877a20c38f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7859ae-4185-4cb6-820c-64877a20c38f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87a44c0-1600-44cf-9135-c2a431a4c752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:46 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume a275e4e2-057e-44e6-a6d2-83f3049fc2d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a275e4e2-057e-44e6-a6d2-83f3049fc2d5', 'volume_size': 1} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-596384503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a275e4e2-057e-44e6-a6d2-83f3049fc2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ccdb34fbcbb4a66b3620213de1fa1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:47Z,use_quota=True,user_id='fd6219729ad54de0930c9d4a98cb4f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Creating volume a275e4e2-057e-44e6-a6d2-83f3049fc2d5 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:46 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:58:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a275e4e2-057e-44e6-a6d2-83f3049fc2d5 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:46 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a275e4e2-057e-44e6-a6d2-83f3049fc2d5 1073741824 Sep 07 13:58:46 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:47 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a275e4e2-057e-44e6-a6d2-83f3049fc2d5 1073741824" returned: 0 in 0.501s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a275e4e2-057e-44e6-a6d2-83f3049fc2d5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:47 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a275e4e2-057e-44e6-a6d2-83f3049fc2d5 Sep 07 13:58:47 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:47 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a275e4e2-057e-44e6-a6d2-83f3049fc2d5" returned: 0 in 0.276s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d87a44c0-1600-44cf-9135-c2a431a4c752) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a275e4e2-057e-44e6-a6d2-83f3049fc2d5', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c5c6fb-4afb-4a81-94b9-12da3b894e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:47 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume volume-a275e4e2-057e-44e6-a6d2-83f3049fc2d5 (a275e4e2-057e-44e6-a6d2-83f3049fc2d5): created successfully Sep 07 13:58:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44c5c6fb-4afb-4a81-94b9-12da3b894e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Flow 'volume_create_manager' (71c25954-096b-4634-8c92-7d95836b3ce0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1c072cb0-7aee-4a5f-b3e0-686e526c5b8c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Created volume successfully. Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Flow 'volume_create_manager' (61da9aca-2ee1-4171-8928-fc7fbf60d694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910e23c6-6802-4fe4-ac14-42488df9f1c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910e23c6-6802-4fe4-ac14-42488df9f1c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-704612998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa7e81c-16f6-4ef0-a539-392d6152a126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ccdb34fbcbb4a66b3620213de1fa1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:49Z,use_quota=True,user_id='fd6219729ad54de0930c9d4a98cb4f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ace516e-b3f3-4ef1-9df5-ee4422966ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ace516e-b3f3-4ef1-9df5-ee4422966ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7df09c-d445-4126-88e5-0a924a1a1d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7df09c-d445-4126-88e5-0a924a1a1d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efa7e81c-16f6-4ef0-a539-392d6152a126', 'volume_name': 'volume-efa7e81c-16f6-4ef0-a539-392d6152a126', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3baa92ec-d754-456d-8089-a638b3a83bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3baa92ec-d754-456d-8089-a638b3a83bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d70749b-e058-40a5-bb26-c88583a4be90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:49 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume efa7e81c-16f6-4ef0-a539-392d6152a126: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efa7e81c-16f6-4ef0-a539-392d6152a126', 'volume_size': 1} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-704612998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efa7e81c-16f6-4ef0-a539-392d6152a126,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ccdb34fbcbb4a66b3620213de1fa1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:49Z,use_quota=True,user_id='fd6219729ad54de0930c9d4a98cb4f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Creating volume efa7e81c-16f6-4ef0-a539-392d6152a126 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:49 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:58:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efa7e81c-16f6-4ef0-a539-392d6152a126 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:49 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efa7e81c-16f6-4ef0-a539-392d6152a126 1073741824 Sep 07 13:58:49 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:50 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:58:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Flow 'volume_create_manager' (eca0eb50-17cb-4057-a4ed-98eabebab84e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501e3ddf-9c76-4227-ae88-1d8d3eff8e63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (501e3ddf-9c76-4227-ae88-1d8d3eff8e63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-306132315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b180f5c9-0b2b-45f3-8b84-f5adb36305cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ccdb34fbcbb4a66b3620213de1fa1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:50Z,use_quota=True,user_id='fd6219729ad54de0930c9d4a98cb4f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d165f2-9c57-4015-833a-f8c38f850915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d165f2-9c57-4015-833a-f8c38f850915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a56653-16fa-4ccf-9036-d9defbe0509b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7a56653-16fa-4ccf-9036-d9defbe0509b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b180f5c9-0b2b-45f3-8b84-f5adb36305cb', 'volume_name': 'volume-b180f5c9-0b2b-45f3-8b84-f5adb36305cb', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013d4c59-be08-4205-94f4-71d02ea7afab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (013d4c59-be08-4205-94f4-71d02ea7afab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34ce5cb-a5f9-41fc-b0ef-69dea9883e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:50 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume b180f5c9-0b2b-45f3-8b84-f5adb36305cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b180f5c9-0b2b-45f3-8b84-f5adb36305cb', 'volume_size': 1} Sep 07 13:58:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:50 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efa7e81c-16f6-4ef0-a539-392d6152a126 1073741824" returned: 0 in 1.064s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efa7e81c-16f6-4ef0-a539-392d6152a126 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:50 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efa7e81c-16f6-4ef0-a539-392d6152a126 Sep 07 13:58:50 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:50 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:58:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Flow 'volume_create_manager' (97d6488d-c1a1-43f6-8c47-19f181e3c11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90678dca-68d0-43a3-9b2d-662c93e6a963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90678dca-68d0-43a3-9b2d-662c93e6a963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1681250966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99a9bef-269c-4e4b-baf6-6ac0cf11b690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ccdb34fbcbb4a66b3620213de1fa1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:51Z,use_quota=True,user_id='fd6219729ad54de0930c9d4a98cb4f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72595366-1afd-4632-8c89-6f3589e0ebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72595366-1afd-4632-8c89-6f3589e0ebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047225f8-b172-4482-bf8f-d2e61cb0f66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047225f8-b172-4482-bf8f-d2e61cb0f66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f99a9bef-269c-4e4b-baf6-6ac0cf11b690', 'volume_name': 'volume-f99a9bef-269c-4e4b-baf6-6ac0cf11b690', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9acadd5-5507-47a8-bd67-b46e44d62e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9acadd5-5507-47a8-bd67-b46e44d62e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160b09a7-872e-4850-a273-2524517fc023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume f99a9bef-269c-4e4b-baf6-6ac0cf11b690: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f99a9bef-269c-4e4b-baf6-6ac0cf11b690', 'volume_size': 1} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:51 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-cf59e363-dbfb-44af-8ee2-719077323b7f req-a8840716-95f1-45d8-8742-7ec880cd206c tempest-TestShelveInstance-1006575646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efa7e81c-16f6-4ef0-a539-392d6152a126" returned: 0 in 0.411s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] <== create_volume: return (1569ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.857s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-306132315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b180f5c9-0b2b-45f3-8b84-f5adb36305cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ccdb34fbcbb4a66b3620213de1fa1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:50Z,use_quota=True,user_id='fd6219729ad54de0930c9d4a98cb4f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Creating volume b180f5c9-0b2b-45f3-8b84-f5adb36305cb {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:51 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b180f5c9-0b2b-45f3-8b84-f5adb36305cb 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d70749b-e058-40a5-bb26-c88583a4be90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efa7e81c-16f6-4ef0-a539-392d6152a126', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d52ec01-84a9-45da-991a-782c7915f7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack sudo[102659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b180f5c9-0b2b-45f3-8b84-f5adb36305cb 1073741824 Sep 07 13:58:51 devstack sudo[102659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:51 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume volume-efa7e81c-16f6-4ef0-a539-392d6152a126 (efa7e81c-16f6-4ef0-a539-392d6152a126): created successfully Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d52ec01-84a9-45da-991a-782c7915f7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Flow 'volume_create_manager' (61da9aca-2ee1-4171-8928-fc7fbf60d694) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:51 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fcb634c4-b1d5-4629-a353-58ef50425e67 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Created volume successfully. Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Flow 'volume_create_manager' (4ac4eec6-c9cb-4175-b137-5dc38a30a05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29ebcda-8dcf-43c7-bfc1-297299b22139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e29ebcda-8dcf-43c7-bfc1-297299b22139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1003155377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093daa56-4733-4758-9d88-500cc26c9e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ccdb34fbcbb4a66b3620213de1fa1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:51Z,use_quota=True,user_id='fd6219729ad54de0930c9d4a98cb4f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9627ad-3542-45ba-9aa2-1814d75459fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9627ad-3542-45ba-9aa2-1814d75459fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9334f1-0fd3-4243-9709-4a92bb217245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd9334f1-0fd3-4243-9709-4a92bb217245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '093daa56-4733-4758-9d88-500cc26c9e95', 'volume_name': 'volume-093daa56-4733-4758-9d88-500cc26c9e95', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94fd5c8e-b3d3-4bc6-b7af-6db63ceb7cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94fd5c8e-b3d3-4bc6-b7af-6db63ceb7cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5dfa77-f362-4f1e-a3dc-32b075699d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume 093daa56-4733-4758-9d88-500cc26c9e95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-093daa56-4733-4758-9d88-500cc26c9e95', 'volume_size': 1} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Flow 'volume_create_manager' (2fed1cef-72b1-4a72-9e01-e134b175b21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c57ec01c-2b9c-4be2-8e90-9ca62d3eade6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c57ec01c-2b9c-4be2-8e90-9ca62d3eade6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1399923286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a1c05c-5003-4767-a034-57669f53a525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ccdb34fbcbb4a66b3620213de1fa1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:52Z,use_quota=True,user_id='fd6219729ad54de0930c9d4a98cb4f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf49bf6f-258a-46d2-b6c4-918307653a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf49bf6f-258a-46d2-b6c4-918307653a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7a88d6-1133-4474-a7be-c7bcfa8bf22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e7a88d6-1133-4474-a7be-c7bcfa8bf22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2a1c05c-5003-4767-a034-57669f53a525', 'volume_name': 'volume-d2a1c05c-5003-4767-a034-57669f53a525', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b27ae1-200c-48a7-86b1-2c1f9aceb0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b27ae1-200c-48a7-86b1-2c1f9aceb0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24f84bd-6f1c-4084-9431-d78b50a59235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:51 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume d2a1c05c-5003-4767-a034-57669f53a525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2a1c05c-5003-4767-a034-57669f53a525', 'volume_size': 1} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:51 devstack sudo[102659]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b180f5c9-0b2b-45f3-8b84-f5adb36305cb 1073741824" returned: 0 in 0.653s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b180f5c9-0b2b-45f3-8b84-f5adb36305cb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:51 devstack sudo[102664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b180f5c9-0b2b-45f3-8b84-f5adb36305cb Sep 07 13:58:51 devstack sudo[102664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:52 devstack sudo[102664]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b180f5c9-0b2b-45f3-8b84-f5adb36305cb" returned: 0 in 0.322s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.082s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1681250966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f99a9bef-269c-4e4b-baf6-6ac0cf11b690,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ccdb34fbcbb4a66b3620213de1fa1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:51Z,use_quota=True,user_id='fd6219729ad54de0930c9d4a98cb4f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Creating volume f99a9bef-269c-4e4b-baf6-6ac0cf11b690 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:52 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f99a9bef-269c-4e4b-baf6-6ac0cf11b690 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34ce5cb-a5f9-41fc-b0ef-69dea9883e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b180f5c9-0b2b-45f3-8b84-f5adb36305cb', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd768bd-5ba0-4620-b52a-127571b8fe69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:52 devstack sudo[102667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f99a9bef-269c-4e4b-baf6-6ac0cf11b690 1073741824 Sep 07 13:58:52 devstack sudo[102667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:52 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume volume-b180f5c9-0b2b-45f3-8b84-f5adb36305cb (b180f5c9-0b2b-45f3-8b84-f5adb36305cb): created successfully Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd768bd-5ba0-4620-b52a-127571b8fe69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Flow 'volume_create_manager' (eca0eb50-17cb-4057-a4ed-98eabebab84e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b2156430-d2a3-48f3-8043-ce23405330b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Created volume successfully. Sep 07 13:58:52 devstack sudo[102667]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f99a9bef-269c-4e4b-baf6-6ac0cf11b690 1073741824" returned: 0 in 0.553s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f99a9bef-269c-4e4b-baf6-6ac0cf11b690 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:52 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f99a9bef-269c-4e4b-baf6-6ac0cf11b690 Sep 07 13:58:52 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:53 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f99a9bef-269c-4e4b-baf6-6ac0cf11b690" returned: 0 in 0.344s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-cf59e363-dbfb-44af-8ee2-719077323b7f req-a8840716-95f1-45d8-8742-7ec880cd206c tempest-TestShelveInstance-1006575646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.030s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-cf59e363-dbfb-44af-8ee2-719077323b7f req-a8840716-95f1-45d8-8742-7ec880cd206c tempest-TestShelveInstance-1006575646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.763s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1003155377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=093daa56-4733-4758-9d88-500cc26c9e95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ccdb34fbcbb4a66b3620213de1fa1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:51Z,use_quota=True,user_id='fd6219729ad54de0930c9d4a98cb4f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Creating volume 093daa56-4733-4758-9d88-500cc26c9e95 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:53 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-093daa56-4733-4758-9d88-500cc26c9e95 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (160b09a7-872e-4850-a273-2524517fc023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f99a9bef-269c-4e4b-baf6-6ac0cf11b690', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e801a5-dad8-4a21-bf04-6da68e7050d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:53 devstack sudo[102677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-093daa56-4733-4758-9d88-500cc26c9e95 1073741824 Sep 07 13:58:53 devstack sudo[102677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume volume-f99a9bef-269c-4e4b-baf6-6ac0cf11b690 (f99a9bef-269c-4e4b-baf6-6ac0cf11b690): created successfully Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e801a5-dad8-4a21-bf04-6da68e7050d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Flow 'volume_create_manager' (97d6488d-c1a1-43f6-8c47-19f181e3c11b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-bc118974-55d3-4cda-b543-db5d551a2a33 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Created volume successfully. Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-cf59e363-dbfb-44af-8ee2-719077323b7f req-a8840716-95f1-45d8-8742-7ec880cd206c tempest-TestShelveInstance-1006575646 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-594cd4ea-2c86-4511-87df-8b8213a82ef4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c368f7fc-11ca-4e45-bc55-dbd4daa2690a', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:58:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-cf59e363-dbfb-44af-8ee2-719077323b7f req-a8840716-95f1-45d8-8742-7ec880cd206c tempest-TestShelveInstance-1006575646 None] attachment_update completed successfully. Sep 07 13:58:53 devstack sudo[102677]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-093daa56-4733-4758-9d88-500cc26c9e95 1073741824" returned: 0 in 0.708s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-093daa56-4733-4758-9d88-500cc26c9e95 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:54 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-093daa56-4733-4758-9d88-500cc26c9e95 Sep 07 13:58:54 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:54 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-093daa56-4733-4758-9d88-500cc26c9e95" returned: 0 in 0.328s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.494s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:58:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1399923286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2a1c05c-5003-4767-a034-57669f53a525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ccdb34fbcbb4a66b3620213de1fa1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:58:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:58:52Z,use_quota=True,user_id='fd6219729ad54de0930c9d4a98cb4f44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Creating volume d2a1c05c-5003-4767-a034-57669f53a525 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:58:54 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d2a1c05c-5003-4767-a034-57669f53a525 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a5dfa77-f362-4f1e-a3dc-32b075699d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-093daa56-4733-4758-9d88-500cc26c9e95', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4bbe211-b7e6-42ce-bed4-9d6a1f5504c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:54 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d2a1c05c-5003-4767-a034-57669f53a525 1073741824 Sep 07 13:58:54 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:54 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume volume-093daa56-4733-4758-9d88-500cc26c9e95 (093daa56-4733-4758-9d88-500cc26c9e95): created successfully Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4bbe211-b7e6-42ce-bed4-9d6a1f5504c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Flow 'volume_create_manager' (4ac4eec6-c9cb-4175-b137-5dc38a30a05a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-00daddf8-e5ef-4454-8fb8-735ce2a035b3 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Created volume successfully. Sep 07 13:58:54 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d2a1c05c-5003-4767-a034-57669f53a525 1073741824" returned: 0 in 0.552s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d2a1c05c-5003-4767-a034-57669f53a525 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:54 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d2a1c05c-5003-4767-a034-57669f53a525 Sep 07 13:58:54 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:55 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d2a1c05c-5003-4767-a034-57669f53a525" returned: 0 in 0.337s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:58:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e24f84bd-6f1c-4084-9431-d78b50a59235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2a1c05c-5003-4767-a034-57669f53a525', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d862fa-58b0-46d6-87a4-b210249946e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:58:55 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Volume volume-d2a1c05c-5003-4767-a034-57669f53a525 (d2a1c05c-5003-4767-a034-57669f53a525): created successfully Sep 07 13:58:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0d862fa-58b0-46d6-87a4-b210249946e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:58:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Flow 'volume_create_manager' (2fed1cef-72b1-4a72-9e01-e134b175b21e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:58:55 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c93deee0-2e47-45eb-9186-daad0138251c tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Created volume successfully. Sep 07 13:58:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "cinder-d2a1c05c-5003-4767-a034-57669f53a525-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-d2a1c05c-5003-4767-a034-57669f53a525-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "cinder-quobyte-d2a1c05c-5003-4767-a034-57669f53a525" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-quobyte-d2a1c05c-5003-4767-a034-57669f53a525" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:56 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[da607d38-6c4f-4d68-b5bd-27d5ba2f75bb]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d2a1c05c-5003-4767-a034-57669f53a525 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:56 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d2a1c05c-5003-4767-a034-57669f53a525 Sep 07 13:58:56 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:57 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d2a1c05c-5003-4767-a034-57669f53a525" returned: 0 in 0.682s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d2a1c05c-5003-4767-a034-57669f53a525 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:57 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d2a1c05c-5003-4767-a034-57669f53a525 Sep 07 13:58:57 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:57 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d2a1c05c-5003-4767-a034-57669f53a525" returned: 0 in 0.505s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-quobyte-d2a1c05c-5003-4767-a034-57669f53a525" released by "delete_volume" :: held 1.265s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:57 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Created reservations ['bf2d4a82-7f4d-45a2-9ee7-76d6c2fe24b1', '95d56df1-243f-4a0f-97e2-db714bff1427', 'c784ad3c-7aec-4d0e-8519-4b6f20bb2053', '0e02b2f0-03a7-4050-a02c-920032283cc6'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:58 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:58:58 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:58 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.413s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:58 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:58:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Deleted volume successfully. Sep 07 13:58:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a4518cb8-ce2c-4d01-aa70-c782876c9168 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-d2a1c05c-5003-4767-a034-57669f53a525-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "cinder-093daa56-4733-4758-9d88-500cc26c9e95-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-093daa56-4733-4758-9d88-500cc26c9e95-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "cinder-quobyte-093daa56-4733-4758-9d88-500cc26c9e95" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:58:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-quobyte-093daa56-4733-4758-9d88-500cc26c9e95" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:58:58 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c1ccd8-d8b4-4948-8fd6-68917af12a30]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:58:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-093daa56-4733-4758-9d88-500cc26c9e95 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:59 devstack sudo[103160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-093daa56-4733-4758-9d88-500cc26c9e95 Sep 07 13:58:59 devstack sudo[103160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:59 devstack sudo[103160]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-093daa56-4733-4758-9d88-500cc26c9e95" returned: 0 in 0.528s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-093daa56-4733-4758-9d88-500cc26c9e95 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:58:59 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-093daa56-4733-4758-9d88-500cc26c9e95 Sep 07 13:58:59 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:58:59 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Sep 07 13:58:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-093daa56-4733-4758-9d88-500cc26c9e95" returned: 0 in 0.298s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:58:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-quobyte-093daa56-4733-4758-9d88-500cc26c9e95" released by "delete_volume" :: held 0.877s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:58:59 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Created reservations ['da4eb869-b983-4d3e-9cc0-351c36f48783', 'e357a622-c473-4f63-a1a2-496b77382651', '5d04a605-ff09-4727-bf2e-6ff6e15f46c8', '681cf2d8-93fd-4563-89bb-8159c17ba6cc'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:58:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:58:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:58:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:58:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:58:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:58:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:00 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:59:00 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "cinder-f99a9bef-269c-4e4b-baf6-6ac0cf11b690-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-f99a9bef-269c-4e4b-baf6-6ac0cf11b690-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "cinder-quobyte-f99a9bef-269c-4e4b-baf6-6ac0cf11b690" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-quobyte-f99a9bef-269c-4e4b-baf6-6ac0cf11b690" acquired by "delete_volume" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[965b2e05-ef56-495b-8197-e83ce74f4527]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f99a9bef-269c-4e4b-baf6-6ac0cf11b690 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:00 devstack sudo[103171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f99a9bef-269c-4e4b-baf6-6ac0cf11b690 Sep 07 13:59:00 devstack sudo[103171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:00 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.504s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:00 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:00 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Deleted volume successfully. Sep 07 13:59:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4a91e11f-3d9e-4cfa-9c94-da60941def2f tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-093daa56-4733-4758-9d88-500cc26c9e95-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:00 devstack sudo[103171]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f99a9bef-269c-4e4b-baf6-6ac0cf11b690" returned: 0 in 0.554s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f99a9bef-269c-4e4b-baf6-6ac0cf11b690 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:00 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f99a9bef-269c-4e4b-baf6-6ac0cf11b690 Sep 07 13:59:00 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:01 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f99a9bef-269c-4e4b-baf6-6ac0cf11b690" returned: 0 in 0.374s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-quobyte-f99a9bef-269c-4e4b-baf6-6ac0cf11b690" released by "delete_volume" :: held 1.022s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:01 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Created reservations ['1c147bdb-fc86-4a35-9b05-750452b5f2b1', 'a32d645a-3b79-4902-9fce-2c52f4c1bb14', '2d1893f1-7ac6-4702-8a5e-7ae8a170b7d4', 'fc4f7cb8-8f56-4167-b8bd-d8d864e5fe49'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:59:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:01 devstack sudo[103180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:59:01 devstack sudo[103180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:01 devstack sudo[103180]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.433s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:01 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Deleted volume successfully. Sep 07 13:59:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cd803b64-e266-48c4-947a-8e1de58d2242 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-f99a9bef-269c-4e4b-baf6-6ac0cf11b690-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "cinder-b180f5c9-0b2b-45f3-8b84-f5adb36305cb-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-b180f5c9-0b2b-45f3-8b84-f5adb36305cb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "cinder-quobyte-b180f5c9-0b2b-45f3-8b84-f5adb36305cb" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-quobyte-b180f5c9-0b2b-45f3-8b84-f5adb36305cb" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:02 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fd4a95-085b-4d8c-93a4-ec0fac13d7e0]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b180f5c9-0b2b-45f3-8b84-f5adb36305cb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:02 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b180f5c9-0b2b-45f3-8b84-f5adb36305cb Sep 07 13:59:02 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:03 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b180f5c9-0b2b-45f3-8b84-f5adb36305cb" returned: 0 in 0.653s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b180f5c9-0b2b-45f3-8b84-f5adb36305cb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:03 devstack sudo[103191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b180f5c9-0b2b-45f3-8b84-f5adb36305cb Sep 07 13:59:03 devstack sudo[103191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:03 devstack sudo[103191]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b180f5c9-0b2b-45f3-8b84-f5adb36305cb" returned: 0 in 0.408s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-quobyte-b180f5c9-0b2b-45f3-8b84-f5adb36305cb" released by "delete_volume" :: held 1.123s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:03 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Created reservations ['ec034083-dd4b-4342-8c34-ebe4a8d1ba82', 'e0b89aea-e720-40a9-95ea-7970180719af', '1f278b5d-fa64-4424-a797-9fabc9bffd66', '75cdd1ff-ec0a-41bb-b435-beab42423d4b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:59:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:03 devstack sudo[103194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:59:03 devstack sudo[103194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:04 devstack sudo[103194]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.578s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:04 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Deleted volume successfully. Sep 07 13:59:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4176fb5d-2930-4994-b86c-370ee85e7cca tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-b180f5c9-0b2b-45f3-8b84-f5adb36305cb-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "cinder-efa7e81c-16f6-4ef0-a539-392d6152a126-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-efa7e81c-16f6-4ef0-a539-392d6152a126-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "cinder-quobyte-efa7e81c-16f6-4ef0-a539-392d6152a126" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-quobyte-efa7e81c-16f6-4ef0-a539-392d6152a126" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[80b9cb04-c97a-4911-ba93-626f3867a00b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efa7e81c-16f6-4ef0-a539-392d6152a126 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:05 devstack sudo[103197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efa7e81c-16f6-4ef0-a539-392d6152a126 Sep 07 13:59:05 devstack sudo[103197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:05 devstack sudo[103197]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efa7e81c-16f6-4ef0-a539-392d6152a126" returned: 0 in 0.472s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efa7e81c-16f6-4ef0-a539-392d6152a126 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:05 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efa7e81c-16f6-4ef0-a539-392d6152a126 Sep 07 13:59:05 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:05 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-efa7e81c-16f6-4ef0-a539-392d6152a126" returned: 0 in 0.468s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-quobyte-efa7e81c-16f6-4ef0-a539-392d6152a126" released by "delete_volume" :: held 1.035s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:06 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Created reservations ['fdf582bd-293e-47b2-9c68-7a8785949ef4', 'c56a5441-8f1e-496d-96d1-b3cdada435af', 'e0f7afdb-7e43-4f6b-9f11-1e5b2e324e64', '06cc001a-f4d6-470b-b481-747489eb0080'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:59:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:06 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:59:06 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:06 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.296s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:06 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Deleted volume successfully. Sep 07 13:59:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0af1f73c-72bc-4a4f-a209-b9cb8248d271 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-efa7e81c-16f6-4ef0-a539-392d6152a126-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "cinder-a275e4e2-057e-44e6-a6d2-83f3049fc2d5-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-a275e4e2-057e-44e6-a6d2-83f3049fc2d5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "cinder-quobyte-a275e4e2-057e-44e6-a6d2-83f3049fc2d5" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-quobyte-a275e4e2-057e-44e6-a6d2-83f3049fc2d5" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2452e3e0-fe70-4915-9a9a-43c875a45e92]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a275e4e2-057e-44e6-a6d2-83f3049fc2d5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:07 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a275e4e2-057e-44e6-a6d2-83f3049fc2d5 Sep 07 13:59:07 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:07 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a275e4e2-057e-44e6-a6d2-83f3049fc2d5" returned: 0 in 0.506s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a275e4e2-057e-44e6-a6d2-83f3049fc2d5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:07 devstack sudo[103216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a275e4e2-057e-44e6-a6d2-83f3049fc2d5 Sep 07 13:59:07 devstack sudo[103216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:08 devstack sudo[103216]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a275e4e2-057e-44e6-a6d2-83f3049fc2d5" returned: 0 in 0.370s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-quobyte-a275e4e2-057e-44e6-a6d2-83f3049fc2d5" released by "delete_volume" :: held 0.953s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Created reservations ['f5d9f157-5b9f-4109-b5f4-e6090f791e58', 'd4d2afb5-4dea-48d5-917a-e88366d0192d', '5f57b8b1-d5ac-4a88-a2dd-3f1be0d15627', '585eb66c-5850-4f43-aed1-e278f19424d7'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:59:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:08 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:59:08 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:08 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.303s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:08 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Deleted volume successfully. Sep 07 13:59:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-32380768-8078-4405-b740-5f80b836c145 tempest-CreateVolumesFromSourceVolumeTest-982598607 None] Lock "cinder-a275e4e2-057e-44e6-a6d2-83f3049fc2d5-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:11 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:59:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Flow 'volume_create_manager' (ff6c305a-62a4-4f16-b9c2-d8d3e1058ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb417baf-ec75-4954-a0a4-bd4feaa447bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb417baf-ec75-4954-a0a4-bd4feaa447bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1528606601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c40e1f-3aca-446a-a36b-ec6ec28dc3fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2304521049e44f07b082bf33fd962d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:12Z,use_quota=True,user_id='be3c12306fab458e940df245bc353677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6cfd43f-8a0b-4a2f-9adc-2514e137e5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6cfd43f-8a0b-4a2f-9adc-2514e137e5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06f762e-a6aa-40b3-9f11-baaa08f3abac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06f762e-a6aa-40b3-9f11-baaa08f3abac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52c40e1f-3aca-446a-a36b-ec6ec28dc3fd', 'volume_name': 'volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c03050-5598-4de6-a36d-9cf393c2e795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c03050-5598-4de6-a36d-9cf393c2e795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5629d14-9177-4a59-b3b5-8595098c5124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:12 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Volume 52c40e1f-3aca-446a-a36b-ec6ec28dc3fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd', 'volume_size': 1} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1528606601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52c40e1f-3aca-446a-a36b-ec6ec28dc3fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2304521049e44f07b082bf33fd962d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:12Z,use_quota=True,user_id='be3c12306fab458e940df245bc353677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Creating volume 52c40e1f-3aca-446a-a36b-ec6ec28dc3fd {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:59:12 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:12 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd 1073741824 Sep 07 13:59:12 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:12 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd 1073741824" returned: 0 in 0.540s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:12 devstack sudo[103228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd Sep 07 13:59:12 devstack sudo[103228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:12 devstack sudo[103228]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd" returned: 0 in 0.337s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5629d14-9177-4a59-b3b5-8595098c5124) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919c708f-824f-4e20-879d-969f08290497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:13 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Volume volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd (52c40e1f-3aca-446a-a36b-ec6ec28dc3fd): created successfully Sep 07 13:59:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (919c708f-824f-4e20-879d-969f08290497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Flow 'volume_create_manager' (ff6c305a-62a4-4f16-b9c2-d8d3e1058ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:13 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-084148c2-8575-46df-aa22-a626ce3274a1 tempest-SnapshotDependencyTests-794936272 None] Created volume successfully. Sep 07 13:59:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] Creating offline snapshot d5f58622-b57c-4dcc-ab65-f57e3d815a5c of volume 52c40e1f-3aca-446a-a36b-ec6ec28dc3fd {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 13:59:14 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[39c31932-fab3-4c4a-9d79-4b11ff2ec351]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:14 devstack sudo[103232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd Sep 07 13:59:14 devstack sudo[103232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:14 devstack sudo[103232]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd" returned: 0 in 0.424s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:14 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c 1G Sep 07 13:59:14 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:15 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c 1G" returned: 0 in 0.614s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:15 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c Sep 07 13:59:15 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:15 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c" returned: 0 in 0.411s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:15 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c is being set with open permissions: ugo+rw Sep 07 13:59:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:15 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c Sep 07 13:59:15 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:16 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c" returned: 0 in 0.285s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:16 devstack sudo[103254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.info Sep 07 13:59:16 devstack sudo[103254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:16 devstack sudo[103254]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.info" returned: 0 in 0.322s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:16 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.info is being set with open permissions: ugo+rw Sep 07 13:59:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:16 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.info Sep 07 13:59:16 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:16 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.info" returned: 0 in 0.274s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.457s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:16 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=176,cinder:SELECT=134,cinder:INSERT=48,cinder:DELETE=10 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:59:16 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=141,cinder:INSERT=48,cinder:UPDATE=181,cinder:DELETE=22 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:59:16 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b77cb277-b8cf-4515-af6b-f89399e843b4 tempest-SnapshotDependencyTests-794936272 None] Create snapshot completed successfully Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Flow 'volume_create_manager' (90d6a7f1-22ea-44f3-8c15-6972f0daaa8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63233fc1-c8b2-4bd2-b823-79b7f290a145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63233fc1-c8b2-4bd2-b823-79b7f290a145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3d6757-1b7b-4369-b352-615ba08e47fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec21e6c7ed54726ba62587c8302d8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:17Z,use_quota=True,user_id='6a038a6cab8649aaa8dc8381baabd2d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d2ae3d-1cf8-4720-bf75-982e52850a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d2ae3d-1cf8-4720-bf75-982e52850a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af24f4c2-15d8-4579-a8dc-c24ebe9cc8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af24f4c2-15d8-4579-a8dc-c24ebe9cc8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8f3d6757-1b7b-4369-b352-615ba08e47fb', 'volume_name': 'volume-8f3d6757-1b7b-4369-b352-615ba08e47fb', 'volume_size': 1, 'image_id': '210fbe1b-fcac-4084-ba7e-c7a998570f1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/210fbe1b-fcac-4084-ba7e-c7a998570f1d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e201c9cf810ed1a304e91beeb7c87b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dec21e6c7ed54726ba62587c8302d8f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b51d13e52d309d7af36d8083d2975882dfcd8c00da1d912af49b2684cc4934f6cd4c98486d1276df7d754e6d88db4dd8b7f715c3748815250beac65822a7200', 'id': '210fbe1b-fcac-4084-ba7e-c7a998570f1d', 'created_at': datetime.datetime(2026, 9, 7, 11, 59, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 59, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/210fbe1b-fcac-4084-ba7e-c7a998570f1d/file', 'properties': {}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736a2c54-43bd-4d66-80a0-8b4fa22801f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (736a2c54-43bd-4d66-80a0-8b4fa22801f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fbf05ba-3829-40b6-93ee-2fe51cd9ace4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:17 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Volume 8f3d6757-1b7b-4369-b352-615ba08e47fb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8f3d6757-1b7b-4369-b352-615ba08e47fb', 'volume_size': 1, 'image_id': '210fbe1b-fcac-4084-ba7e-c7a998570f1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/210fbe1b-fcac-4084-ba7e-c7a998570f1d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e201c9cf810ed1a304e91beeb7c87b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dec21e6c7ed54726ba62587c8302d8f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b51d13e52d309d7af36d8083d2975882dfcd8c00da1d912af49b2684cc4934f6cd4c98486d1276df7d754e6d88db4dd8b7f715c3748815250beac65822a7200', 'id': '210fbe1b-fcac-4084-ba7e-c7a998570f1d', 'created_at': datetime.datetime(2026, 9, 7, 11, 59, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 59, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/210fbe1b-fcac-4084-ba7e-c7a998570f1d/file', 'properties': {}}, 'image_service': } Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Trying to clone 8f3d6757-1b7b-4369-b352-615ba08e47fb from image 210fbe1b-fcac-4084-ba7e-c7a998570f1d at location (None, [{'url': 'file:///opt/stack/data/glance/images/210fbe1b-fcac-4084-ba7e-c7a998570f1d', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 13:59:17 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Image download 0.00 MB at 0.00 MB/s Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65502b5-fbfb-407a-85b3-03e24574a29f]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:17 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD Sep 07 13:59:17 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:17 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD" returned: 0 in 0.355s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:17 devstack sudo[103301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD Sep 07 13:59:17 devstack sudo[103301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:18 devstack sudo[103301]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD" returned: 1 in 0.408s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Temporary image 210fbe1b-fcac-4084-ba7e-c7a998570f1d is fetched for user 6a038a6cab8649aaa8dc8381baabd2d9. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Flow 'volume_create_manager' (95d90053-5b04-42bf-b1a6-1d67d58dc054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0a90568-fa61-43d7-999b-91fa54b45839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0a90568-fa61-43d7-999b-91fa54b45839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2304521049e44f07b082bf33fd962d5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d5f58622-b57c-4dcc-ab65-f57e3d815a5c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:18Z,use_quota=True,user_id='be3c12306fab458e940df245bc353677',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2e3700-375a-4806-a904-ccf9f5742d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c2e3700-375a-4806-a904-ccf9f5742d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca878faf-3258-490d-89ae-7bc6dab3619f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca878faf-3258-490d-89ae-7bc6dab3619f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a', 'volume_name': 'volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a', 'volume_size': 1, 'snapshot_id': 'd5f58622-b57c-4dcc-ab65-f57e3d815a5c'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706af794-bec5-40a4-b6d7-4359879ac147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706af794-bec5-40a4-b6d7-4359879ac147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da7aca6a-ff8f-4bde-8a37-e79174526725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:18 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Volume aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a', 'volume_size': 1, 'snapshot_id': 'd5f58622-b57c-4dcc-ab65-f57e3d815a5c'} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "cinder-quobyte-d5f58622-b57c-4dcc-ab65-f57e3d815a5c-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18a1f83-6a56-4934-a22c-ed37d39a7d27]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-quobyte-d5f58622-b57c-4dcc-ab65-f57e3d815a5c-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Creating volume aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a from snapshot d5f58622-b57c-4dcc-ab65-f57e3d815a5c {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "cinder-quobyte-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-quobyte-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] snapshot: d5f58622-b57c-4dcc-ab65-f57e3d815a5c, volume: aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[734493fa-df84-4aaf-ba8a-b9657e24d9e3]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:18 devstack sudo[103306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD Sep 07 13:59:18 devstack sudo[103306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:18 devstack sudo[103307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c Sep 07 13:59:18 devstack sudo[103307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:18 devstack sudo[103306]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD" returned: 0 in 0.360s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:18 devstack sudo[103307]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c" returned: 0 in 0.372s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[653ebb2b-7f33-4b69-b4ac-aad7a59fcd93]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:18 devstack sudo[103312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD Sep 07 13:59:18 devstack sudo[103312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:18 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd Sep 07 13:59:18 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:19 devstack sudo[103312]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD" returned: 1 in 0.347s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:59:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:19 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd" returned: 0 in 0.374s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] will copy from snapshot at /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 13:59:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 13:59:19 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Path /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 13:59:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:19 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a Sep 07 13:59:19 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:23 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a" returned: 0 in 4.322s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Image conversion details: src /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd, size 1024.00 MB, duration 4.32 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:59:23 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Converted 1024.00 MB image at 236.87 MB/s Sep 07 13:59:23 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a is being set with open permissions: ugo+rw Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:23 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a Sep 07 13:59:23 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:23 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a" returned: 0 in 0.241s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-quobyte-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a" released by "_copy_volume_from_snapshot" :: held 5.391s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-quobyte-d5f58622-b57c-4dcc-ab65-f57e3d815a5c-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a" released by "_create_volume_from_snapshot" :: held 5.458s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.487s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.761s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f3d6757-1b7b-4369-b352-615ba08e47fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dec21e6c7ed54726ba62587c8302d8f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:17Z,use_quota=True,user_id='6a038a6cab8649aaa8dc8381baabd2d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Creating volume 8f3d6757-1b7b-4369-b352-615ba08e47fb {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:59:23 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:23 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb 1073741824 Sep 07 13:59:23 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da7aca6a-ff8f-4bde-8a37-e79174526725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a', 'volume_size': 1, 'snapshot_id': 'd5f58622-b57c-4dcc-ab65-f57e3d815a5c'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada9aa14-fd8b-4749-b99f-2b53e25d0566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:23 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Volume volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a (aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a): created successfully Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ada9aa14-fd8b-4749-b99f-2b53e25d0566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Flow 'volume_create_manager' (95d90053-5b04-42bf-b1a6-1d67d58dc054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:23 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-09fa0659-15a0-4d1b-821b-2101053dafce tempest-SnapshotDependencyTests-794936272 None] Created volume successfully. Sep 07 13:59:24 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb 1073741824" returned: 0 in 0.458s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:24 devstack sudo[103347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb Sep 07 13:59:24 devstack sudo[103347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:24 devstack sudo[103347]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb" returned: 0 in 0.266s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Attempting download of 210fbe1b-fcac-4084-ba7e-c7a998570f1d ((None, [{'url': 'file:///opt/stack/data/glance/images/210fbe1b-fcac-4084-ba7e-c7a998570f1d', 'metadata': {}}])) to volume 8f3d6757-1b7b-4369-b352-615ba08e47fb. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe23afb-6c2f-4bb6-9b03-38219c0ad1e5]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_210fbe1b-fcac-4084-ba7e-c7a998570f1d_roqfrof1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "cinder-d5f58622-b57c-4dcc-ab65-f57e3d815a5c-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-d5f58622-b57c-4dcc-ab65-f57e3d815a5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "cinder-quobyte-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:24 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_210fbe1b-fcac-4084-ba7e-c7a998570f1d_roqfrof1 Sep 07 13:59:24 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-quobyte-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "cinder-quobyte-d5f58622-b57c-4dcc-ab65-f57e3d815a5c" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-quobyte-d5f58622-b57c-4dcc-ab65-f57e3d815a5c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Deleting offline snapshot d5f58622-b57c-4dcc-ab65-f57e3d815a5c of volume 52c40e1f-3aca-446a-a36b-ec6ec28dc3fd {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] snapshot_file for this snap is: volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1ae40a-9860-4177-b6c1-fcf9bb1fc0be]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:25 devstack sudo[103352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c Sep 07 13:59:25 devstack sudo[103352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:25 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_210fbe1b-fcac-4084-ba7e-c7a998570f1d_roqfrof1" returned: 0 in 0.383s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_210fbe1b-fcac-4084-ba7e-c7a998570f1d_roqfrof1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:25 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_210fbe1b-fcac-4084-ba7e-c7a998570f1d_roqfrof1 Sep 07 13:59:25 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:25 devstack sudo[103352]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c" returned: 0 in 0.416s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 13:59:25 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c2fa27-901a-4d45-b9cd-1b33d6a8bb61]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:25 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_210fbe1b-fcac-4084-ba7e-c7a998570f1d_roqfrof1" returned: 1 in 0.361s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_210fbe1b-fcac-4084-ba7e-c7a998570f1d_roqfrof1' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:59:25 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d683d8-e994-4c7e-8257-1d0e64c8b92a]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:25 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd Sep 07 13:59:25 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:25 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD Sep 07 13:59:25 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:25 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:25 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd" returned: 0 in 0.567s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:25 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c Sep 07 13:59:25 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:25 devstack sudo[103372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD Sep 07 13:59:25 devstack sudo[103372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:26 devstack sudo[103372]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 13:59:26 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] 210fbe1b-fcac-4084-ba7e-c7a998570f1d was raw, converting to qcow2 {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 13:59:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:26 devstack sudo[103383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb Sep 07 13:59:26 devstack sudo[103383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:26 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c" returned: 0 in 0.362s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:26 devstack sudo[103385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c Sep 07 13:59:26 devstack sudo[103385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:26 devstack sudo[103385]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd.d5f58622-b57c-4dcc-ab65-f57e3d815a5c" returned: 0 in 0.262s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-quobyte-d5f58622-b57c-4dcc-ab65-f57e3d815a5c" released by "_delete_snapshot" :: held 1.720s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-quobyte-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd" released by "delete_snapshot" :: held 1.749s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:26 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Created reservations ['551f79f7-fa28-4a7f-82f4-d8081112395d', '89d1485d-9102-4bc2-b7b2-d318259ac7ac', 'ddf00fa6-c7d5-4e34-9542-363f4fff0519', 'b0a0790a-bed4-4d9a-8fa6-1119376b5b1f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:59:26 devstack sudo[103383]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Delete snapshot completed successfully. Sep 07 13:59:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb" returned: 0 in 0.521s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:26 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_210fbe1b-fcac-4084-ba7e-c7a998570f1d_j0q1vec5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 13:59:26 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 13:59:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d5055cf2-d69d-411f-a0d5-7103855f2fdf tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-d5f58622-b57c-4dcc-ab65-f57e3d815a5c-delete_snapshot" released by "delete_snapshot" :: held 1.923s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:26 devstack sudo[103392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb 1G Sep 07 13:59:26 devstack sudo[103392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "cinder-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "cinder-quobyte-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-quobyte-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df96d41-2a68-4d68-82ca-d88aa66aa1b3]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:27 devstack sudo[103392]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb 1G" returned: 0 in 0.434s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Downloaded image 210fbe1b-fcac-4084-ba7e-c7a998570f1d ((None, [{'url': 'file:///opt/stack/data/glance/images/210fbe1b-fcac-4084-ba7e-c7a998570f1d', 'metadata': {}}])) to volume 8f3d6757-1b7b-4369-b352-615ba08e47fb successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Temporary image 210fbe1b-fcac-4084-ba7e-c7a998570f1d for user 6a038a6cab8649aaa8dc8381baabd2d9 is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Marking volume 8f3d6757-1b7b-4369-b352-615ba08e47fb as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Copying metadata from image 210fbe1b-fcac-4084-ba7e-c7a998570f1d to 8f3d6757-1b7b-4369-b352-615ba08e47fb. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Creating volume glance metadata for volume 8f3d6757-1b7b-4369-b352-615ba08e47fb backed by image 210fbe1b-fcac-4084-ba7e-c7a998570f1d with: {'image_id': '210fbe1b-fcac-4084-ba7e-c7a998570f1d', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5e201c9cf810ed1a304e91beeb7c87b6', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fbf05ba-3829-40b6-93ee-2fe51cd9ace4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f3d6757-1b7b-4369-b352-615ba08e47fb', 'volume_size': 1, 'image_id': '210fbe1b-fcac-4084-ba7e-c7a998570f1d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/210fbe1b-fcac-4084-ba7e-c7a998570f1d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e201c9cf810ed1a304e91beeb7c87b6', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dec21e6c7ed54726ba62587c8302d8f6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b51d13e52d309d7af36d8083d2975882dfcd8c00da1d912af49b2684cc4934f6cd4c98486d1276df7d754e6d88db4dd8b7f715c3748815250beac65822a7200', 'id': '210fbe1b-fcac-4084-ba7e-c7a998570f1d', 'created_at': datetime.datetime(2026, 9, 7, 11, 59, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 11, 59, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/210fbe1b-fcac-4084-ba7e-c7a998570f1d/file', 'properties': {}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0633865b-af99-4145-895f-8ab4dce791aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:27 devstack sudo[103398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd Sep 07 13:59:27 devstack sudo[103398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:27 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Volume volume-8f3d6757-1b7b-4369-b352-615ba08e47fb (8f3d6757-1b7b-4369-b352-615ba08e47fb): created successfully Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0633865b-af99-4145-895f-8ab4dce791aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Flow 'volume_create_manager' (90d6a7f1-22ea-44f3-8c15-6972f0daaa8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:27 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7cd2d6ed-b089-4b46-b065-bf00df63eb70 tempest-VolumeImageDependencyTests-2021947281 None] Created volume successfully. Sep 07 13:59:27 devstack sudo[103398]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd" returned: 0 in 0.416s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:27 devstack sudo[103403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd Sep 07 13:59:27 devstack sudo[103403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:27 devstack sudo[103403]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd" returned: 0 in 0.268s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-quobyte-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd" released by "delete_volume" :: held 0.760s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Created reservations ['64a2535a-40ff-4556-bde7-6b2937a49f64', '7c008b8c-b9f8-4622-ae87-98f0698404f7', 'f196dd90-5dd6-4cc4-b6cc-ef90a3d28383', '6ec1aefb-9355-478e-b4fb-ecd5749c712c'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Acquiring lock "cinder-8f3d6757-1b7b-4369-b352-615ba08e47fb-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:28 devstack sudo[103410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:59:28 devstack sudo[103410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Lock "cinder-8f3d6757-1b7b-4369-b352-615ba08e47fb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Acquiring lock "cinder-quobyte-8f3d6757-1b7b-4369-b352-615ba08e47fb" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Lock "cinder-quobyte-8f3d6757-1b7b-4369-b352-615ba08e47fb" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[97a89bcc-254a-4fdb-af80-f1bff51b398c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "cinder-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "cinder-quobyte-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:28 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb Sep 07 13:59:28 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-quobyte-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:28 devstack sudo[103410]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.381s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Deleted volume successfully. Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[39178f5f-ba11-4b60-9e5e-dafe2e52f79a]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9209e848-8591-41d8-ab68-c287a02a434d tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-52c40e1f-3aca-446a-a36b-ec6ec28dc3fd-delete_volume" released by "delete_volume" :: held 1.394s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:28 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a Sep 07 13:59:28 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:28 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb" returned: 0 in 0.497s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:28 devstack sudo[103426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb Sep 07 13:59:28 devstack sudo[103426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:28 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a" returned: 0 in 0.423s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:28 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a Sep 07 13:59:28 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:28 devstack sudo[103426]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8f3d6757-1b7b-4369-b352-615ba08e47fb" returned: 0 in 0.277s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Lock "cinder-quobyte-8f3d6757-1b7b-4369-b352-615ba08e47fb" released by "delete_volume" :: held 0.827s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Created reservations ['0c840e2e-78ef-4f2e-b22a-36590f38dc20', 'c47049f1-285b-429b-acc0-4bf134893c53', 'df0580e4-f8ab-422e-be9d-9ee5756c856a', '4dc86f61-1606-4012-b369-d8ce86312a82'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:29 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:59:29 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:29 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a" returned: 0 in 0.375s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-quobyte-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a" released by "delete_volume" :: held 0.862s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Created reservations ['a38f15e7-3b6a-4ea2-a59c-33713d68e7c6', '30d3eada-ae9f-430a-9b69-2bd0f8f43890', 'e11df79c-9412-4e01-b0a4-5db4d0c940bf', 'a22d8482-d14a-4445-be41-34f20af7b876'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:29 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:59:29 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:29 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.427s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Deleted volume successfully. Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7cb33e94-e915-431b-b0f8-44b22db1b68c tempest-VolumeImageDependencyTests-2021947281 None] Lock "cinder-8f3d6757-1b7b-4369-b352-615ba08e47fb-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:29 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.361s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Deleted volume successfully. Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bcfc79d3-0cbe-4f0e-83e5-d0a2d6dbe48a tempest-SnapshotDependencyTests-794936272 None] Lock "cinder-aa339915-43d5-4ffe-bdaa-2ab2f4c75a1a-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:29 devstack sudo[103446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:59:29 devstack sudo[103446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:30 devstack sudo[103446]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.295s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 13:59:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 29 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 13:59:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 13:59:32 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-380f8070-c90d-4a15-a49e-7305418d3dc4 req-83c16855-685a-4a55-9759-602ef241fdff tempest-TestShelveInstance-1006575646 None] Terminate volume connection completed successfully. Sep 07 13:59:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-380f8070-c90d-4a15-a49e-7305418d3dc4 req-83c16855-685a-4a55-9759-602ef241fdff tempest-TestShelveInstance-1006575646 None] Deleting attachment c368f7fc-11ca-4e45-bc55-dbd4daa2690a. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 13:59:33 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:59:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Flow 'volume_create_manager' (46863edb-52ce-47c4-9293-b1f9947e314b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32d5d85-60fd-47a2-96ee-9a18d7f102c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d32d5d85-60fd-47a2-96ee-9a18d7f102c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-638737013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9813bd1e-6c77-4198-b28d-4893bda3be14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2575ca86b00f4458a638abdb04b6f8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:34Z,use_quota=True,user_id='163fd6bc9d354f43b31af128fccd0795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c1920e-10ad-46ff-b85b-7f49e4060039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99c1920e-10ad-46ff-b85b-7f49e4060039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1111d326-574e-4ef4-a79d-5594e0b5083c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1111d326-574e-4ef4-a79d-5594e0b5083c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9813bd1e-6c77-4198-b28d-4893bda3be14', 'volume_name': 'volume-9813bd1e-6c77-4198-b28d-4893bda3be14', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce545d9-b416-4caa-9712-557ebad98a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce545d9-b416-4caa-9712-557ebad98a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dafe2bc-4320-4989-a8b2-09c2d046d9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:34 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Volume 9813bd1e-6c77-4198-b28d-4893bda3be14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9813bd1e-6c77-4198-b28d-4893bda3be14', 'volume_size': 1} Sep 07 13:59:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-638737013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9813bd1e-6c77-4198-b28d-4893bda3be14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2575ca86b00f4458a638abdb04b6f8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:34Z,use_quota=True,user_id='163fd6bc9d354f43b31af128fccd0795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:59:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Creating volume 9813bd1e-6c77-4198-b28d-4893bda3be14 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:59:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:59:34 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:59:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9813bd1e-6c77-4198-b28d-4893bda3be14 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:34 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9813bd1e-6c77-4198-b28d-4893bda3be14 1073741824 Sep 07 13:59:34 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:34 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9813bd1e-6c77-4198-b28d-4893bda3be14 1073741824" returned: 0 in 0.612s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9813bd1e-6c77-4198-b28d-4893bda3be14 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:34 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9813bd1e-6c77-4198-b28d-4893bda3be14 Sep 07 13:59:34 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:35 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9813bd1e-6c77-4198-b28d-4893bda3be14" returned: 0 in 0.352s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] <== create_volume: return (1017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:59:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dafe2bc-4320-4989-a8b2-09c2d046d9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9813bd1e-6c77-4198-b28d-4893bda3be14', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cdbd38-37ac-4b52-8da3-0a9989250670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:35 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Volume volume-9813bd1e-6c77-4198-b28d-4893bda3be14 (9813bd1e-6c77-4198-b28d-4893bda3be14): created successfully Sep 07 13:59:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6cdbd38-37ac-4b52-8da3-0a9989250670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Flow 'volume_create_manager' (46863edb-52ce-47c4-9293-b1f9947e314b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:35 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7797b2ea-d086-4a25-8850-45616447550d tempest-ProjectReaderTests-1928351445 None] Created volume successfully. Sep 07 13:59:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-a0953ca2-d854-497d-b8ec-a1245eff235d req-5c1b9da3-bb4b-4ff4-adfc-769ace7d802d tempest-TestShelveInstance-1006575646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-a0953ca2-d854-497d-b8ec-a1245eff235d req-5c1b9da3-bb4b-4ff4-adfc-769ace7d802d tempest-TestShelveInstance-1006575646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-a0953ca2-d854-497d-b8ec-a1245eff235d req-5c1b9da3-bb4b-4ff4-adfc-769ace7d802d tempest-TestShelveInstance-1006575646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-a0953ca2-d854-497d-b8ec-a1245eff235d req-5c1b9da3-bb4b-4ff4-adfc-769ace7d802d tempest-TestShelveInstance-1006575646 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-594cd4ea-2c86-4511-87df-8b8213a82ef4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3958c494-095a-4647-bf9a-4ec891bcc7b6', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 13:59:36 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-a0953ca2-d854-497d-b8ec-a1245eff235d req-5c1b9da3-bb4b-4ff4-adfc-769ace7d802d tempest-TestShelveInstance-1006575646 None] attachment_update completed successfully. Sep 07 13:59:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Acquiring lock "cinder-9813bd1e-6c77-4198-b28d-4893bda3be14-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Lock "cinder-9813bd1e-6c77-4198-b28d-4893bda3be14-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Acquiring lock "cinder-quobyte-9813bd1e-6c77-4198-b28d-4893bda3be14" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Lock "cinder-quobyte-9813bd1e-6c77-4198-b28d-4893bda3be14" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:36 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b267df-2c00-475e-b712-4649afd26f03]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9813bd1e-6c77-4198-b28d-4893bda3be14 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:36 devstack sudo[103492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9813bd1e-6c77-4198-b28d-4893bda3be14 Sep 07 13:59:36 devstack sudo[103492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:37 devstack sudo[103492]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9813bd1e-6c77-4198-b28d-4893bda3be14" returned: 0 in 0.487s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9813bd1e-6c77-4198-b28d-4893bda3be14 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:37 devstack sudo[103499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9813bd1e-6c77-4198-b28d-4893bda3be14 Sep 07 13:59:37 devstack sudo[103499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:37 devstack sudo[103499]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-9813bd1e-6c77-4198-b28d-4893bda3be14" returned: 0 in 0.324s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Lock "cinder-quobyte-9813bd1e-6c77-4198-b28d-4893bda3be14" released by "delete_volume" :: held 0.878s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:37 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Created reservations ['b4e74e80-ba19-4bf6-bc66-625c36866ac5', '69457d7e-0e9a-4982-bc62-38434e332a0b', 'db8ef41a-4af0-4428-a79f-85f91aa7189a', '904ae560-448a-4df7-bb83-bfeaa0a7a316'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:59:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:37 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:59:37 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:37 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.332s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:37 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Deleted volume successfully. Sep 07 13:59:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-40424ddc-3c92-45fc-8f4e-4c94a9391763 tempest-ProjectReaderTests-1928351445 None] Lock "cinder-9813bd1e-6c77-4198-b28d-4893bda3be14-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Flow 'volume_create_manager' (f726013f-4817-440d-b94f-0fb73e97ebb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0277274-9624-4569-bdf1-d13ac9e45d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0277274-9624-4569-bdf1-d13ac9e45d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177259071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2575ca86b00f4458a638abdb04b6f8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:38Z,use_quota=True,user_id='163fd6bc9d354f43b31af128fccd0795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a278f11-a357-442c-bfbe-d839268e966e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a278f11-a357-442c-bfbe-d839268e966e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b765e0-facb-4760-9d39-8ffeb1fadf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03b765e0-facb-4760-9d39-8ffeb1fadf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0', 'volume_name': 'volume-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82e1a46-c683-4324-99ae-eed98ef20cab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c82e1a46-c683-4324-99ae-eed98ef20cab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a191699-38f1-48a4-81cd-72a8b4e1cc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:38 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Volume 1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0', 'volume_size': 1} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T11:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177259071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2575ca86b00f4458a638abdb04b6f8c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T11:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T11:59:38Z,use_quota=True,user_id='163fd6bc9d354f43b31af128fccd0795',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Creating volume 1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 13:59:38 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:38 devstack sudo[103505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0 1073741824 Sep 07 13:59:38 devstack sudo[103505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:38 devstack sudo[103505]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0 1073741824" returned: 0 in 0.472s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:38 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0 Sep 07 13:59:38 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:39 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0" returned: 0 in 0.347s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 13:59:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a191699-38f1-48a4-81cd-72a8b4e1cc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77a1f6b-f066-4304-b81d-e97c584c986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 13:59:39 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Volume volume-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0 (1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0): created successfully Sep 07 13:59:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a77a1f6b-f066-4304-b81d-e97c584c986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 13:59:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Flow 'volume_create_manager' (f726013f-4817-440d-b94f-0fb73e97ebb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 13:59:39 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e7f40070-3334-4706-aee0-dd36f3c428fd tempest-ProjectReaderTests-1928351445 None] Created volume successfully. Sep 07 13:59:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Acquiring lock "cinder-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Lock "cinder-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Acquiring lock "cinder-quobyte-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 13:59:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Lock "cinder-quobyte-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 13:59:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[076bcc4d-3c61-4c68-97f6-f53d896ff8fd]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 13:59:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:41 devstack sudo[103958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0 Sep 07 13:59:41 devstack sudo[103958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:41 devstack sudo[103958]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0" returned: 0 in 0.575s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:41 devstack sudo[103967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0 Sep 07 13:59:41 devstack sudo[103967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:41 devstack sudo[103967]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0" returned: 0 in 0.404s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Lock "cinder-quobyte-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0" released by "delete_volume" :: held 1.092s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:42 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Created reservations ['defe8a97-9b07-498e-8c53-95968818e7af', 'cb480dd9-cc9d-46d1-9291-c1b1685c8478', 'b1aaadce-0191-4958-836a-7f94059509fd', '3127ae5c-74b9-46ea-93b1-db7a6a56e6ce'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 13:59:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 13:59:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 13:59:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 13:59:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 13:59:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 13:59:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 13:59:42 devstack sudo[103972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 13:59:42 devstack sudo[103972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 13:59:42 devstack sudo[103972]: pam_unix(sudo:session): session closed for user root Sep 07 13:59:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.354s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 13:59:42 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 13:59:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Deleted volume successfully. Sep 07 13:59:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cff11057-19eb-4378-93af-5313de28b430 tempest-ProjectReaderTests-1928351445 None] Lock "cinder-1c10a8c1-0b6b-4556-83e0-d2e169d8c7b0-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 13:59:52 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:DELETE=3,cinder:SELECT=58,cinder:UPDATE=64,cinder:INSERT=17 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 13:59:52 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=48,cinder:UPDATE=57,cinder:INSERT=20,cinder:DELETE=7 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:00:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-6bfb3037-b050-443c-91d3-2a164b62cf74 tempest-TestShelveInstance-1006575646 None] Terminate volume connection completed successfully. Sep 07 14:00:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-6bfb3037-b050-443c-91d3-2a164b62cf74 tempest-TestShelveInstance-1006575646 None] Deleting attachment 3958c494-095a-4647-bf9a-4ec891bcc7b6. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 14:00:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Acquiring lock "cinder-594cd4ea-2c86-4511-87df-8b8213a82ef4-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:00:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Lock "cinder-594cd4ea-2c86-4511-87df-8b8213a82ef4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:00:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Acquiring lock "cinder-quobyte-594cd4ea-2c86-4511-87df-8b8213a82ef4" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:00:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Lock "cinder-quobyte-594cd4ea-2c86-4511-87df-8b8213a82ef4" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:00:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ed7bd8-e89c-4b5f-a8fd-c8399afa5a23]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:00:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:22 devstack sudo[104092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4 Sep 07 14:00:22 devstack sudo[104092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:22 devstack sudo[104092]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4" returned: 0 in 0.368s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:22 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4 Sep 07 14:00:22 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:23 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-594cd4ea-2c86-4511-87df-8b8213a82ef4" returned: 0 in 0.244s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Lock "cinder-quobyte-594cd4ea-2c86-4511-87df-8b8213a82ef4" released by "delete_volume" :: held 0.655s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:00:23 devstack cinder-volume[87444]: DEBUG cinder.quota [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Created reservations ['e22d79fe-73f7-476c-bcf1-b918c6fdfe77', '504c31b6-cb16-4b2b-b2d5-78eba6a3ce17', '22306b9f-5219-4af2-b3e2-afd364fdfa1b', '0f2352de-e769-4f70-b4c4-a5478d487f4d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:00:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:00:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:00:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:00:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:00:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:00:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:23 devstack sudo[104101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:00:23 devstack sudo[104101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:23 devstack sudo[104101]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.274s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:23 devstack cinder-volume[87444]: DEBUG cinder.manager [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:00:23 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Deleted volume successfully. Sep 07 14:00:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-2a249dd2-3121-486c-8fdd-cba0999d09e4 req-8f31778f-06cd-4a12-841e-47069e7996d5 tempest-TestShelveInstance-1006575646 None] Lock "cinder-594cd4ea-2c86-4511-87df-8b8213a82ef4-delete_volume" released by "delete_volume" :: held 1.147s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:00:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:00:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:00:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:00:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:00:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:00:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:00:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:29 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:00:29 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:30 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.266s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:00:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:00:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 29 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 14:00:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 14:00:33 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=8,cinder:SELECT=5,cinder:INSERT=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:00:33 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Flow 'volume_create_manager' (bdf56491-270a-4c1e-aa16-ae004ca0fdb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df86f449-4180-4962-8741-e3df17794fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df86f449-4180-4962-8741-e3df17794fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1086493246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9506d95-e8cd-48a8-b774-c742ab3e8696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3ed4873c384a18a691eb17673eca7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:00:57Z,use_quota=True,user_id='8f83f87b27f449ea94df7b0b2a9e386f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5609858-7f41-4084-9fff-0a74263faf27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5609858-7f41-4084-9fff-0a74263faf27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a06655a4-e0d3-4163-ad43-60649b4688c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a06655a4-e0d3-4163-ad43-60649b4688c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9506d95-e8cd-48a8-b774-c742ab3e8696', 'volume_name': 'volume-b9506d95-e8cd-48a8-b774-c742ab3e8696', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b7b280-c79d-4d54-ac6d-f185d70bf663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9b7b280-c79d-4d54-ac6d-f185d70bf663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee07f4e-e9ac-481d-99e6-a61bd15d39fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:00:56 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Volume b9506d95-e8cd-48a8-b774-c742ab3e8696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9506d95-e8cd-48a8-b774-c742ab3e8696', 'volume_size': 1} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:00:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1086493246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9506d95-e8cd-48a8-b774-c742ab3e8696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3ed4873c384a18a691eb17673eca7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:00:57Z,use_quota=True,user_id='8f83f87b27f449ea94df7b0b2a9e386f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Creating volume b9506d95-e8cd-48a8-b774-c742ab3e8696 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:00:56 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:00:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:56 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 1073741824 Sep 07 14:00:56 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:57 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 1073741824" returned: 0 in 0.453s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:00:57 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 Sep 07 14:00:57 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:00:57 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Sep 07 14:00:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696" returned: 0 in 0.310s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:00:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:00:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:00:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ee07f4e-e9ac-481d-99e6-a61bd15d39fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9506d95-e8cd-48a8-b774-c742ab3e8696', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:00:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cad0fae-19a2-45b4-bbee-85188a56b1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:00:57 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Volume volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 (b9506d95-e8cd-48a8-b774-c742ab3e8696): created successfully Sep 07 14:00:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cad0fae-19a2-45b4-bbee-85188a56b1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:00:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Flow 'volume_create_manager' (bdf56491-270a-4c1e-aa16-ae004ca0fdb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:00:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-90749052-143d-44b4-845f-1cfdb7357ee6 tempest-TestStampPattern-665014011 None] Created volume successfully. Sep 07 14:01:07 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:01:07 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:01:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-b094ff2a-5e6a-4782-b6e2-5e53806f20b1 req-f43e2a19-f444-4e88-8906-03e57dd66e4a tempest-TestStampPattern-665014011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:01:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-b094ff2a-5e6a-4782-b6e2-5e53806f20b1 req-f43e2a19-f444-4e88-8906-03e57dd66e4a tempest-TestStampPattern-665014011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:01:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-b094ff2a-5e6a-4782-b6e2-5e53806f20b1 req-f43e2a19-f444-4e88-8906-03e57dd66e4a tempest-TestStampPattern-665014011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:01:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-b094ff2a-5e6a-4782-b6e2-5e53806f20b1 req-f43e2a19-f444-4e88-8906-03e57dd66e4a tempest-TestStampPattern-665014011 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-b9506d95-e8cd-48a8-b774-c742ab3e8696', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5109db5c-e4fb-44c8-9b19-ecb2b453af09', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 14:01:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-b094ff2a-5e6a-4782-b6e2-5e53806f20b1 req-f43e2a19-f444-4e88-8906-03e57dd66e4a tempest-TestStampPattern-665014011 None] attachment_update completed successfully. Sep 07 14:01:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:01:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:01:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:01:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:01:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:01:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:01:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:01:29 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:01:29 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:01:30 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Sep 07 14:01:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.267s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:01:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:01:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:01:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 29 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 14:01:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 14:01:30 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-25e6601d-8dc1-4f8d-bc30-d80bcda6a919 req-6067d1d8-1a73-43e2-a21d-e373c9129bfe tempest-TestStampPattern-665014011 None] Terminate volume connection completed successfully. Sep 07 14:01:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-25e6601d-8dc1-4f8d-bc30-d80bcda6a919 req-6067d1d8-1a73-43e2-a21d-e373c9129bfe tempest-TestStampPattern-665014011 None] Deleting attachment 5109db5c-e4fb-44c8-9b19-ecb2b453af09. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 14:01:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:01:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:01:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] Creating offline snapshot 8d864934-470f-44d8-ac20-b36799bfa364 of volume b9506d95-e8cd-48a8-b774-c742ab3e8696 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:01:31 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[044df676-6954-4b31-9eb7-5954c2140546]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:01:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:01:31 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 Sep 07 14:01:31 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:01:31 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Sep 07 14:01:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696" returned: 0 in 0.350s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:01:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:01:31 devstack sudo[104747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 1G Sep 07 14:01:31 devstack sudo[104747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:01:32 devstack sudo[104747]: pam_unix(sudo:session): session closed for user root Sep 07 14:01:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 1G" returned: 0 in 0.395s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:01:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:01:32 devstack sudo[104752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 Sep 07 14:01:32 devstack sudo[104752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:01:32 devstack sudo[104752]: pam_unix(sudo:session): session closed for user root Sep 07 14:01:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364" returned: 0 in 0.283s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:01:32 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 is being set with open permissions: ugo+rw Sep 07 14:01:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:01:32 devstack sudo[104757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 Sep 07 14:01:32 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:01:32 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root Sep 07 14:01:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364" returned: 0 in 0.242s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:01:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:01:32 devstack sudo[104760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.info Sep 07 14:01:32 devstack sudo[104760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:01:32 devstack sudo[104760]: pam_unix(sudo:session): session closed for user root Sep 07 14:01:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.info" returned: 0 in 0.243s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:01:32 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.info is being set with open permissions: ugo+rw Sep 07 14:01:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:01:32 devstack sudo[104763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.info Sep 07 14:01:32 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:01:33 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root Sep 07 14:01:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.info" returned: 0 in 0.239s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:01:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.834s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:01:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d713e45f-06ea-425e-875b-c0c4d92d7727 tempest-TestStampPattern-665014011 None] Create snapshot completed successfully Sep 07 14:01:39 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:01:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Flow 'volume_create_manager' (5bf889ed-592f-4e29-9450-56f08d672dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:01:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c8d36d-b90e-4c0b-a181-54b27dc485fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62c8d36d-b90e-4c0b-a181-54b27dc485fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2125949125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ebaf22f-61d2-4948-8850-82a00f688a58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e3ed4873c384a18a691eb17673eca7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8d864934-470f-44d8-ac20-b36799bfa364,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:01:40Z,use_quota=True,user_id='8f83f87b27f449ea94df7b0b2a9e386f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f145f7d-44f8-41e8-92e7-3693ea63e49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f145f7d-44f8-41e8-92e7-3693ea63e49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b873e927-ffb6-4c93-be57-9e8975c702b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b873e927-ffb6-4c93-be57-9e8975c702b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5ebaf22f-61d2-4948-8850-82a00f688a58', 'volume_name': 'volume-5ebaf22f-61d2-4948-8850-82a00f688a58', 'volume_size': 1, 'snapshot_id': '8d864934-470f-44d8-ac20-b36799bfa364'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bd3b81-e146-470a-b09a-2d4dbb48b1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bd3b81-e146-470a-b09a-2d4dbb48b1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46be115-b04e-4e3e-b3b4-b4c61d721f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:01:40 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Volume 5ebaf22f-61d2-4948-8850-82a00f688a58: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5ebaf22f-61d2-4948-8850-82a00f688a58', 'volume_size': 1, 'snapshot_id': '8d864934-470f-44d8-ac20-b36799bfa364'} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Acquiring lock "cinder-quobyte-8d864934-470f-44d8-ac20-b36799bfa364-5ebaf22f-61d2-4948-8850-82a00f688a58" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Lock "cinder-quobyte-8d864934-470f-44d8-ac20-b36799bfa364-5ebaf22f-61d2-4948-8850-82a00f688a58" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Creating volume 5ebaf22f-61d2-4948-8850-82a00f688a58 from snapshot 8d864934-470f-44d8-ac20-b36799bfa364 {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Acquiring lock "cinder-quobyte-5ebaf22f-61d2-4948-8850-82a00f688a58" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Lock "cinder-quobyte-5ebaf22f-61d2-4948-8850-82a00f688a58" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] snapshot: 8d864934-470f-44d8-ac20-b36799bfa364, volume: 5ebaf22f-61d2-4948-8850-82a00f688a58, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f296221-27d0-42e9-b91c-d72a02a6c73a]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:01:40 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 Sep 07 14:01:40 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:01:40 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364" returned: 0 in 0.405s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9506d95-e8cd-48a8-b774-c742ab3e8696(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[997b82f3-68f3-4a39-afb5-2c068bc76de8]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:01:40 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 Sep 07 14:01:40 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:01:40 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696" returned: 0 in 0.381s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] will copy from snapshot at /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Path /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5ebaf22f-61d2-4948-8850-82a00f688a58 not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 14:01:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5ebaf22f-61d2-4948-8850-82a00f688a58 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:01:40 devstack sudo[104807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5ebaf22f-61d2-4948-8850-82a00f688a58 Sep 07 14:01:40 devstack sudo[104807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:01:46 devstack sudo[104807]: pam_unix(sudo:session): session closed for user root Sep 07 14:01:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5ebaf22f-61d2-4948-8850-82a00f688a58" returned: 0 in 5.889s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:01:46 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Image conversion details: src /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5ebaf22f-61d2-4948-8850-82a00f688a58 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 14:01:46 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Converted 1024.00 MB image at 173.86 MB/s Sep 07 14:01:46 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5ebaf22f-61d2-4948-8850-82a00f688a58 is being set with open permissions: ugo+rw Sep 07 14:01:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5ebaf22f-61d2-4948-8850-82a00f688a58 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:01:46 devstack sudo[104833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5ebaf22f-61d2-4948-8850-82a00f688a58 Sep 07 14:01:46 devstack sudo[104833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:01:47 devstack sudo[104833]: pam_unix(sudo:session): session closed for user root Sep 07 14:01:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5ebaf22f-61d2-4948-8850-82a00f688a58" returned: 0 in 0.284s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:01:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Lock "cinder-quobyte-5ebaf22f-61d2-4948-8850-82a00f688a58" released by "_copy_volume_from_snapshot" :: held 7.053s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:01:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Lock "cinder-quobyte-8d864934-470f-44d8-ac20-b36799bfa364-5ebaf22f-61d2-4948-8850-82a00f688a58" released by "_create_volume_from_snapshot" :: held 7.124s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:01:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.141s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:01:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b46be115-b04e-4e3e-b3b4-b4c61d721f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ebaf22f-61d2-4948-8850-82a00f688a58', 'volume_size': 1, 'snapshot_id': '8d864934-470f-44d8-ac20-b36799bfa364'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:01:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c458d8ac-8988-4458-a168-d532ff933c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:01:47 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Volume volume-5ebaf22f-61d2-4948-8850-82a00f688a58 (5ebaf22f-61d2-4948-8850-82a00f688a58): created successfully Sep 07 14:01:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c458d8ac-8988-4458-a168-d532ff933c46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:01:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Flow 'volume_create_manager' (5bf889ed-592f-4e29-9450-56f08d672dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:01:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fe5bd50e-5c7a-4a97-8ef2-84252334499d tempest-TestStampPattern-665014011 None] Created volume successfully. Sep 07 14:01:57 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:01:57 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=15,cinder:UPDATE=7,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:02:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-144d4a0b-7093-4039-b040-de9381e0c58c req-d066bd84-c8df-47b0-8bb0-30461957058e tempest-TestStampPattern-665014011 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:02:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-144d4a0b-7093-4039-b040-de9381e0c58c req-d066bd84-c8df-47b0-8bb0-30461957058e tempest-TestStampPattern-665014011 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:02:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-144d4a0b-7093-4039-b040-de9381e0c58c req-d066bd84-c8df-47b0-8bb0-30461957058e tempest-TestStampPattern-665014011 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:02:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-144d4a0b-7093-4039-b040-de9381e0c58c req-d066bd84-c8df-47b0-8bb0-30461957058e tempest-TestStampPattern-665014011 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35', 'name': 'volume-5ebaf22f-61d2-4948-8850-82a00f688a58', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef3a1d6d-7403-4fa1-bca5-fb4dfb7e5c41', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 07 14:02:16 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-144d4a0b-7093-4039-b040-de9381e0c58c req-d066bd84-c8df-47b0-8bb0-30461957058e tempest-TestStampPattern-665014011 None] attachment_update completed successfully. Sep 07 14:02:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-98b44337-1206-4112-9ade-4d93b5857a15 req-da3cf57a-f699-4902-acb8-267d84417060 tempest-TestStampPattern-665014011 None] Terminate volume connection completed successfully. Sep 07 14:02:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-98b44337-1206-4112-9ade-4d93b5857a15 req-da3cf57a-f699-4902-acb8-267d84417060 tempest-TestStampPattern-665014011 None] Deleting attachment ef3a1d6d-7403-4fa1-bca5-fb4dfb7e5c41. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 07 14:02:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Acquiring lock "cinder-5ebaf22f-61d2-4948-8850-82a00f688a58-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:02:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Lock "cinder-5ebaf22f-61d2-4948-8850-82a00f688a58-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:02:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Acquiring lock "cinder-quobyte-5ebaf22f-61d2-4948-8850-82a00f688a58" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:02:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Lock "cinder-quobyte-5ebaf22f-61d2-4948-8850-82a00f688a58" acquired by "delete_volume" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:02:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfb7cb5-b3b2-4846-8c7e-0d31219a32fd]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:02:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5ebaf22f-61d2-4948-8850-82a00f688a58 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:22 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5ebaf22f-61d2-4948-8850-82a00f688a58 Sep 07 14:02:22 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:23 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5ebaf22f-61d2-4948-8850-82a00f688a58" returned: 0 in 0.356s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5ebaf22f-61d2-4948-8850-82a00f688a58 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:23 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5ebaf22f-61d2-4948-8850-82a00f688a58 Sep 07 14:02:23 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:23 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5ebaf22f-61d2-4948-8850-82a00f688a58" returned: 0 in 0.242s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Lock "cinder-quobyte-5ebaf22f-61d2-4948-8850-82a00f688a58" released by "delete_volume" :: held 0.636s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:02:23 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Created reservations ['59e8aa28-9213-43ec-946c-9c894738d8a9', 'd0ea9f72-4812-4afe-a10a-56e8dd156239', 'b25271e8-c270-4e1f-bd68-76fbbdb2be95', '95601d60-0448-46e7-a68b-314c4f789114'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:02:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:02:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:02:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:02:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:02:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:02:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:23 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:02:23 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:23 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.258s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:23 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:02:23 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Deleted volume successfully. Sep 07 14:02:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a1f18acf-09f9-4fe1-ade5-7b6cea30583f tempest-TestStampPattern-665014011 None] Lock "cinder-5ebaf22f-61d2-4948-8850-82a00f688a58-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:02:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Acquiring lock "cinder-8d864934-470f-44d8-ac20-b36799bfa364-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:02:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Lock "cinder-8d864934-470f-44d8-ac20-b36799bfa364-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:02:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Acquiring lock "cinder-quobyte-b9506d95-e8cd-48a8-b774-c742ab3e8696" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:02:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Lock "cinder-quobyte-b9506d95-e8cd-48a8-b774-c742ab3e8696" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:02:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Acquiring lock "cinder-quobyte-8d864934-470f-44d8-ac20-b36799bfa364" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:02:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Lock "cinder-quobyte-8d864934-470f-44d8-ac20-b36799bfa364" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:02:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Deleting offline snapshot 8d864934-470f-44d8-ac20-b36799bfa364 of volume b9506d95-e8cd-48a8-b774-c742ab3e8696 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:02:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] snapshot_file for this snap is: volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:02:24 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc64230-8563-4071-8864-69875b99d403]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:02:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:24 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 Sep 07 14:02:24 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:24 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364" returned: 0 in 0.353s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9506d95-e8cd-48a8-b774-c742ab3e8696(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:02:24 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a022475-551e-4226-b74b-2ba8f89a2c0e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:02:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:24 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 Sep 07 14:02:24 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:25 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696" returned: 0 in 0.492s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:25 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 Sep 07 14:02:25 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:25 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364" returned: 0 in 0.317s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:25 devstack sudo[105457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364 Sep 07 14:02:25 devstack sudo[105457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:25 devstack sudo[105457]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696.8d864934-470f-44d8-ac20-b36799bfa364" returned: 0 in 0.239s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Lock "cinder-quobyte-8d864934-470f-44d8-ac20-b36799bfa364" released by "_delete_snapshot" :: held 1.494s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:02:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Lock "cinder-quobyte-b9506d95-e8cd-48a8-b774-c742ab3e8696" released by "delete_snapshot" :: held 1.513s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:02:25 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Created reservations ['c4e67c92-f47a-40d8-ad89-4d2aff38d8e5', 'bb7dc4d3-4ab5-46e3-b4dc-5f3b7153653c', 'accfd8c5-9513-4321-9a0b-49bb94b85dd6', '4f1919e5-10b8-4026-ad57-c001d9885686'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:02:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Delete snapshot completed successfully. Sep 07 14:02:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-adc0a6cb-286a-43b3-8062-c9245166f832 tempest-TestStampPattern-665014011 None] Lock "cinder-8d864934-470f-44d8-ac20-b36799bfa364-delete_snapshot" released by "delete_snapshot" :: held 1.638s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:02:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Acquiring lock "cinder-b9506d95-e8cd-48a8-b774-c742ab3e8696-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:02:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Lock "cinder-b9506d95-e8cd-48a8-b774-c742ab3e8696-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:02:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Acquiring lock "cinder-quobyte-b9506d95-e8cd-48a8-b774-c742ab3e8696" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:02:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Lock "cinder-quobyte-b9506d95-e8cd-48a8-b774-c742ab3e8696" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:02:29 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f3f4235-23fb-4b43-8228-a63bd6871eb1]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:02:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:02:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:02:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:02:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:02:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:02:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:02:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:29 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:02:29 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:29 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 Sep 07 14:02:29 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:30 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.278s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 29 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 14:02:30 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696" returned: 0 in 0.375s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:30 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696 Sep 07 14:02:30 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:30 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-b9506d95-e8cd-48a8-b774-c742ab3e8696" returned: 0 in 0.239s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Lock "cinder-quobyte-b9506d95-e8cd-48a8-b774-c742ab3e8696" released by "delete_volume" :: held 0.669s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Created reservations ['db8c2097-c7f4-44dc-b917-e971c2a2114b', 'd216f443-0568-4aa9-a6fb-e583f133ca62', 'b965aa06-3e03-4a6f-8de0-cc07bddddee8', '41609e32-b98d-4b0c-add0-0c3788675a51'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:30 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:02:30 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:30 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.240s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:02:30 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Deleted volume successfully. Sep 07 14:02:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4740c0b1-57fd-44d7-949d-29de97f79de2 tempest-TestStampPattern-665014011 None] Lock "cinder-b9506d95-e8cd-48a8-b774-c742ab3e8696-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:02:40 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=19,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:02:40 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=27,cinder:UPDATE=21,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:02:45 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:02:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Flow 'volume_create_manager' (499d60ba-83a9-4cdd-9f03-0a81ad569c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:02:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06591fa0-4c1d-45b5-b1c8-90518b45faa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06591fa0-4c1d-45b5-b1c8-90518b45faa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654efc45-405e-4df4-8bda-d87c6e51a484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a48510bebe4d5286d90aa7707ef489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:02:46Z,use_quota=True,user_id='8c4f6c01588546a1b873e8b8cb3f8f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cbec5c6-8403-4a77-ad9d-78b2cb5dff24),volume_type_id=3cbec5c6-8403-4a77-ad9d-78b2cb5dff24)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac75df2b-52e7-4b90-b3e6-fb2a9038ad1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac75df2b-52e7-4b90-b3e6-fb2a9038ad1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38992a4b-0759-4d91-8804-d73edefa6a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:45 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 14:02:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38992a4b-0759-4d91-8804-d73edefa6a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '654efc45-405e-4df4-8bda-d87c6e51a484', 'volume_name': 'volume-654efc45-405e-4df4-8bda-d87c6e51a484', 'volume_size': 1, 'image_id': 'ec419fc7-873a-444f-a8ac-b5f193f77105', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec419fc7-873a-444f-a8ac-b5f193f77105', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c16e0cfd58b2a940a30d6cd2d910f3cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '37a48510bebe4d5286d90aa7707ef489', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60cc8b683c9a754b0e65dbf2734b11b0818dd988ea94cc3c1db322cc42c46e4d440bad61ef56eb7fbb75833bc029edf7963ad94a3a7aae8196201219febb2766', 'id': 'ec419fc7-873a-444f-a8ac-b5f193f77105', 'created_at': datetime.datetime(2026, 9, 7, 12, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 2, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec419fc7-873a-444f-a8ac-b5f193f77105/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0129fd71-84fc-42f8-a7e3-efe1a0db7905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0129fd71-84fc-42f8-a7e3-efe1a0db7905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0f2f25-ff45-4528-90f7-d27e976a68dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:45 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Volume 654efc45-405e-4df4-8bda-d87c6e51a484: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-654efc45-405e-4df4-8bda-d87c6e51a484', 'volume_size': 1, 'image_id': 'ec419fc7-873a-444f-a8ac-b5f193f77105', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec419fc7-873a-444f-a8ac-b5f193f77105', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c16e0cfd58b2a940a30d6cd2d910f3cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '37a48510bebe4d5286d90aa7707ef489', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60cc8b683c9a754b0e65dbf2734b11b0818dd988ea94cc3c1db322cc42c46e4d440bad61ef56eb7fbb75833bc029edf7963ad94a3a7aae8196201219febb2766', 'id': 'ec419fc7-873a-444f-a8ac-b5f193f77105', 'created_at': datetime.datetime(2026, 9, 7, 12, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 2, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec419fc7-873a-444f-a8ac-b5f193f77105/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 07 14:02:45 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Trying to clone 654efc45-405e-4df4-8bda-d87c6e51a484 from image ec419fc7-873a-444f-a8ac-b5f193f77105 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ec419fc7-873a-444f-a8ac-b5f193f77105', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 14:02:46 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 14:02:46 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Image download 0.00 MB at 0.00 MB/s Sep 07 14:02:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[484472eb-0773-4c09-afd7-d22ce821411a]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:02:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:46 devstack sudo[105509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD Sep 07 14:02:46 devstack sudo[105509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:46 devstack sudo[105509]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:46 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD Sep 07 14:02:46 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:46 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:02:46 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Temporary image ec419fc7-873a-444f-a8ac-b5f193f77105 is fetched for user 8c4f6c01588546a1b873e8b8cb3f8f43. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 14:02:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f9eaaf-faf4-46b3-8f99-52c16f664861]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:02:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:47 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD Sep 07 14:02:47 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:47 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:47 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD Sep 07 14:02:47 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:47 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:02:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:02:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:02:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=654efc45-405e-4df4-8bda-d87c6e51a484,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37a48510bebe4d5286d90aa7707ef489',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:02:46Z,use_quota=True,user_id='8c4f6c01588546a1b873e8b8cb3f8f43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cbec5c6-8403-4a77-ad9d-78b2cb5dff24),volume_type_id=3cbec5c6-8403-4a77-ad9d-78b2cb5dff24)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:02:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Creating volume 654efc45-405e-4df4-8bda-d87c6e51a484 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:02:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:02:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:02:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:02:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:02:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:02:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:02:47 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:02:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:47 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484 1073741824 Sep 07 14:02:47 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:48 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484 1073741824" returned: 0 in 0.428s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:48 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484 Sep 07 14:02:48 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:48 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484" returned: 0 in 0.271s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:02:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:02:48 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Attempting download of ec419fc7-873a-444f-a8ac-b5f193f77105 ((None, [{'url': 'file:///opt/stack/data/glance/images/ec419fc7-873a-444f-a8ac-b5f193f77105', 'metadata': {}}])) to volume 654efc45-405e-4df4-8bda-d87c6e51a484. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 14:02:48 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8156e901-a283-4aec-916b-e8dd9e7e42dc]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:02:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec419fc7-873a-444f-a8ac-b5f193f77105_gofufops {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:48 devstack sudo[105570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec419fc7-873a-444f-a8ac-b5f193f77105_gofufops Sep 07 14:02:48 devstack sudo[105570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:48 devstack sudo[105570]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ec419fc7-873a-444f-a8ac-b5f193f77105_gofufops" returned: 0 in 0.333s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec419fc7-873a-444f-a8ac-b5f193f77105_gofufops {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:48 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec419fc7-873a-444f-a8ac-b5f193f77105_gofufops Sep 07 14:02:48 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:49 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec419fc7-873a-444f-a8ac-b5f193f77105_gofufops" returned: 1 in 0.344s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ec419fc7-873a-444f-a8ac-b5f193f77105_gofufops' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:02:49 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1295711a-9923-4e23-bd56-05e983119496]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:02:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:49 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD Sep 07 14:02:49 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:49 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD" returned: 0 in 0.333s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:49 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD Sep 07 14:02:49 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:49 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD" returned: 1 in 0.338s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:02:49 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] ec419fc7-873a-444f-a8ac-b5f193f77105 was raw, converting to qcow2 {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 14:02:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:49 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484 Sep 07 14:02:49 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:50 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484" returned: 0 in 0.424s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:50 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ec419fc7-873a-444f-a8ac-b5f193f77105_c_a0lpikdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 14:02:50 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 14:02:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:50 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484 1G Sep 07 14:02:50 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:50 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484 1G" returned: 0 in 0.310s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:50 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Downloaded image ec419fc7-873a-444f-a8ac-b5f193f77105 ((None, [{'url': 'file:///opt/stack/data/glance/images/ec419fc7-873a-444f-a8ac-b5f193f77105', 'metadata': {}}])) to volume 654efc45-405e-4df4-8bda-d87c6e51a484 successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 14:02:50 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Temporary image ec419fc7-873a-444f-a8ac-b5f193f77105 for user 8c4f6c01588546a1b873e8b8cb3f8f43 is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 14:02:50 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Marking volume 654efc45-405e-4df4-8bda-d87c6e51a484 as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 14:02:50 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Copying metadata from image ec419fc7-873a-444f-a8ac-b5f193f77105 to 654efc45-405e-4df4-8bda-d87c6e51a484. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 14:02:50 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Creating volume glance metadata for volume 654efc45-405e-4df4-8bda-d87c6e51a484 backed by image ec419fc7-873a-444f-a8ac-b5f193f77105 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ec419fc7-873a-444f-a8ac-b5f193f77105', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c16e0cfd58b2a940a30d6cd2d910f3cd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 14:02:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0f2f25-ff45-4528-90f7-d27e976a68dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-654efc45-405e-4df4-8bda-d87c6e51a484', 'volume_size': 1, 'image_id': 'ec419fc7-873a-444f-a8ac-b5f193f77105', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ec419fc7-873a-444f-a8ac-b5f193f77105', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c16e0cfd58b2a940a30d6cd2d910f3cd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '37a48510bebe4d5286d90aa7707ef489', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '60cc8b683c9a754b0e65dbf2734b11b0818dd988ea94cc3c1db322cc42c46e4d440bad61ef56eb7fbb75833bc029edf7963ad94a3a7aae8196201219febb2766', 'id': 'ec419fc7-873a-444f-a8ac-b5f193f77105', 'created_at': datetime.datetime(2026, 9, 7, 12, 2, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 2, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ec419fc7-873a-444f-a8ac-b5f193f77105/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81845cdf-078c-4597-acd2-b9bf376230a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:50 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Volume volume-654efc45-405e-4df4-8bda-d87c6e51a484 (654efc45-405e-4df4-8bda-d87c6e51a484): created successfully Sep 07 14:02:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81845cdf-078c-4597-acd2-b9bf376230a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Flow 'volume_create_manager' (499d60ba-83a9-4cdd-9f03-0a81ad569c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:02:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-06c9a07f-627d-490d-9521-dfdf6fbfa0a1 tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Created volume successfully. Sep 07 14:02:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Acquiring lock "cinder-654efc45-405e-4df4-8bda-d87c6e51a484-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:02:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Lock "cinder-654efc45-405e-4df4-8bda-d87c6e51a484-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:02:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Acquiring lock "cinder-quobyte-654efc45-405e-4df4-8bda-d87c6e51a484" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:02:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Lock "cinder-quobyte-654efc45-405e-4df4-8bda-d87c6e51a484" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:02:51 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4d1b61-e028-4d81-ba69-0ff3d8f5c91e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:02:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:51 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484 Sep 07 14:02:51 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:51 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484" returned: 0 in 0.369s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:51 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484 Sep 07 14:02:51 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:51 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-654efc45-405e-4df4-8bda-d87c6e51a484" returned: 0 in 0.270s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Lock "cinder-quobyte-654efc45-405e-4df4-8bda-d87c6e51a484" released by "delete_volume" :: held 0.682s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:02:51 devstack cinder-volume[87444]: WARNING cinder.quota [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 07 14:02:51 devstack cinder-volume[87444]: WARNING cinder.quota [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 07 14:02:51 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Created reservations ['54b4fe8d-0ef0-40c6-880e-49fcd5a7ab38', '02bf7e97-f786-4e95-9a0b-d32bad902b32', 'af7286f7-4173-424d-be61-5f2cc8207333', 'ece34764-ce3d-49de-89c8-d896bb1893cf'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:02:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:02:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:02:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:02:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:02:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:02:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:51 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:02:51 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:52 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.312s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:52 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:02:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Deleted volume successfully. Sep 07 14:02:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dff64078-914c-45be-96aa-e4af1d6f253c tempest-VolumeAndVolumeTypeFromImageTest-1729956179 None] Lock "cinder-654efc45-405e-4df4-8bda-d87c6e51a484-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Flow 'volume_create_manager' (36c9d000-b7bd-4553-abf2-c464cae32aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555870c0-525e-48e7-b1aa-07371016b889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (555870c0-525e-48e7-b1aa-07371016b889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1965477815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ae6108-8ef6-483a-a1d7-e921045d08cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a71f058ffe14a9c8fb23d9b56b2ed86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:02:56Z,use_quota=True,user_id='aa96790cacee433c8c4732e219d8b7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255c0a78-e4b2-46ab-9c16-0c14ae8d1956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255c0a78-e4b2-46ab-9c16-0c14ae8d1956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (820d84eb-ad10-4f6f-ab58-3830a575722d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (820d84eb-ad10-4f6f-ab58-3830a575722d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3ae6108-8ef6-483a-a1d7-e921045d08cd', 'volume_name': 'volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2324796-522a-47f2-b525-584cea39b913) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2324796-522a-47f2-b525-584cea39b913) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25db81fb-2067-48f1-9d51-9662bc9ac990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:56 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Volume e3ae6108-8ef6-483a-a1d7-e921045d08cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd', 'volume_size': 1} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1965477815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ae6108-8ef6-483a-a1d7-e921045d08cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a71f058ffe14a9c8fb23d9b56b2ed86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:02:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:02:56Z,use_quota=True,user_id='aa96790cacee433c8c4732e219d8b7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Creating volume e3ae6108-8ef6-483a-a1d7-e921045d08cd {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:02:56 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:56 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd 1073741824 Sep 07 14:02:56 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:56 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd 1073741824" returned: 0 in 0.423s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:56 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd Sep 07 14:02:56 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:57 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd" returned: 0 in 0.249s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:02:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:02:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25db81fb-2067-48f1-9d51-9662bc9ac990) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64370c06-8a96-4215-b86b-70c7c3fffd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:02:57 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Volume volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd (e3ae6108-8ef6-483a-a1d7-e921045d08cd): created successfully Sep 07 14:02:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64370c06-8a96-4215-b86b-70c7c3fffd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:02:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Flow 'volume_create_manager' (36c9d000-b7bd-4553-abf2-c464cae32aa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:02:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e4368b86-8434-47ea-8b95-347e5ab18cce tempest-VolumeDependencyTests-362814326 None] Created volume successfully. Sep 07 14:02:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:02:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:02:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] Creating offline snapshot a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 of volume e3ae6108-8ef6-483a-a1d7-e921045d08cd {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:02:57 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4218ced8-e548-486f-a3a7-045c8891d414]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:02:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:57 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd Sep 07 14:02:57 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:58 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd" returned: 0 in 0.350s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:58 devstack sudo[105628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 1G Sep 07 14:02:58 devstack sudo[105628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:58 devstack sudo[105628]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 1G" returned: 0 in 0.390s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:58 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 Sep 07 14:02:58 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:58 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6" returned: 0 in 0.289s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:58 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 is being set with open permissions: ugo+rw Sep 07 14:02:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:58 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 Sep 07 14:02:58 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:58 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6" returned: 0 in 0.252s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:59 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.info Sep 07 14:02:59 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:59 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.info" returned: 0 in 0.259s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:59 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.info is being set with open permissions: ugo+rw Sep 07 14:02:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:02:59 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.info Sep 07 14:02:59 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:02:59 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 07 14:02:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.info" returned: 0 in 0.245s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:02:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.869s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:02:59 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-10b18b63-aec8-421e-bd25-b375d1841663 tempest-VolumeDependencyTests-362814326 None] Create snapshot completed successfully Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Flow 'volume_create_manager' (0a01b911-5f3d-4339-bc68-79f6182c8c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1ddd62-6f90-4a17-af22-8b41f90cc41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da1ddd62-6f90-4a17-af22-8b41f90cc41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1094163741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8680131-f91e-4e72-b8c1-38f493ea071e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a71f058ffe14a9c8fb23d9b56b2ed86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a4fe51af-ed0a-4a53-a4aa-b503c5954ee6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:00Z,use_quota=True,user_id='aa96790cacee433c8c4732e219d8b7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54717c78-d8ee-4238-b9ce-427eb3838fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54717c78-d8ee-4238-b9ce-427eb3838fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e21def4-cafc-42cf-98d5-666cf4a0c975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e21def4-cafc-42cf-98d5-666cf4a0c975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e8680131-f91e-4e72-b8c1-38f493ea071e', 'volume_name': 'volume-e8680131-f91e-4e72-b8c1-38f493ea071e', 'volume_size': 1, 'snapshot_id': 'a4fe51af-ed0a-4a53-a4aa-b503c5954ee6'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e730a5-afba-4dd4-8237-a970159528ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7e730a5-afba-4dd4-8237-a970159528ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45ad550-b7fb-48b7-a215-dbec3bad7dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:00 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Volume e8680131-f91e-4e72-b8c1-38f493ea071e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e8680131-f91e-4e72-b8c1-38f493ea071e', 'volume_size': 1, 'snapshot_id': 'a4fe51af-ed0a-4a53-a4aa-b503c5954ee6'} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Acquiring lock "cinder-quobyte-a4fe51af-ed0a-4a53-a4aa-b503c5954ee6-e8680131-f91e-4e72-b8c1-38f493ea071e" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Lock "cinder-quobyte-a4fe51af-ed0a-4a53-a4aa-b503c5954ee6-e8680131-f91e-4e72-b8c1-38f493ea071e" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Creating volume e8680131-f91e-4e72-b8c1-38f493ea071e from snapshot a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Acquiring lock "cinder-quobyte-e8680131-f91e-4e72-b8c1-38f493ea071e" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Lock "cinder-quobyte-e8680131-f91e-4e72-b8c1-38f493ea071e" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] snapshot: a4fe51af-ed0a-4a53-a4aa-b503c5954ee6, volume: e8680131-f91e-4e72-b8c1-38f493ea071e, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c034448b-68fb-4cdd-b7a2-8c8ca1c81066]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:00 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 Sep 07 14:03:00 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:00 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6" returned: 0 in 0.361s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e02db6b-a077-4916-981d-0ae975fb4f56]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:00 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd Sep 07 14:03:00 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:01 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd" returned: 0 in 0.378s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] will copy from snapshot at /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 14:03:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 14:03:01 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Path /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e8680131-f91e-4e72-b8c1-38f493ea071e not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 14:03:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e8680131-f91e-4e72-b8c1-38f493ea071e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:01 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e8680131-f91e-4e72-b8c1-38f493ea071e Sep 07 14:03:01 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:05 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e8680131-f91e-4e72-b8c1-38f493ea071e" returned: 0 in 3.997s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Image conversion details: src /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd, size 1024.00 MB, duration 4.00 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e8680131-f91e-4e72-b8c1-38f493ea071e {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 14:03:05 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Converted 1024.00 MB image at 256.10 MB/s Sep 07 14:03:05 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e8680131-f91e-4e72-b8c1-38f493ea071e is being set with open permissions: ugo+rw Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e8680131-f91e-4e72-b8c1-38f493ea071e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:05 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e8680131-f91e-4e72-b8c1-38f493ea071e Sep 07 14:03:05 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:05 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e8680131-f91e-4e72-b8c1-38f493ea071e" returned: 0 in 0.254s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Lock "cinder-quobyte-e8680131-f91e-4e72-b8c1-38f493ea071e" released by "_copy_volume_from_snapshot" :: held 5.066s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Lock "cinder-quobyte-a4fe51af-ed0a-4a53-a4aa-b503c5954ee6-e8680131-f91e-4e72-b8c1-38f493ea071e" released by "_create_volume_from_snapshot" :: held 5.125s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.141s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45ad550-b7fb-48b7-a215-dbec3bad7dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8680131-f91e-4e72-b8c1-38f493ea071e', 'volume_size': 1, 'snapshot_id': 'a4fe51af-ed0a-4a53-a4aa-b503c5954ee6'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b0fc27-9084-4b7a-84c4-ae4a77f06593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:05 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Volume volume-e8680131-f91e-4e72-b8c1-38f493ea071e (e8680131-f91e-4e72-b8c1-38f493ea071e): created successfully Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b0fc27-9084-4b7a-84c4-ae4a77f06593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Flow 'volume_create_manager' (0a01b911-5f3d-4339-bc68-79f6182c8c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:05 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b847f597-a387-4352-8b35-ed94210640c0 tempest-VolumeDependencyTests-362814326 None] Created volume successfully. Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Acquiring lock "cinder-a4fe51af-ed0a-4a53-a4aa-b503c5954ee6-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Lock "cinder-a4fe51af-ed0a-4a53-a4aa-b503c5954ee6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Acquiring lock "cinder-quobyte-e3ae6108-8ef6-483a-a1d7-e921045d08cd" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Lock "cinder-quobyte-e3ae6108-8ef6-483a-a1d7-e921045d08cd" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Acquiring lock "cinder-quobyte-a4fe51af-ed0a-4a53-a4aa-b503c5954ee6" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Lock "cinder-quobyte-a4fe51af-ed0a-4a53-a4aa-b503c5954ee6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Deleting offline snapshot a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 of volume e3ae6108-8ef6-483a-a1d7-e921045d08cd {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] snapshot_file for this snap is: volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7782ee2c-bcd9-476d-9aa0-a1d3b3537764]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:05 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 Sep 07 14:03:05 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:06 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6" returned: 0 in 0.345s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:03:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaf3343-ee42-4e9c-a22d-a8d5ee416c96]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:06 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd Sep 07 14:03:06 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:06 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd" returned: 0 in 0.497s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:06 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 Sep 07 14:03:06 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:06 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6" returned: 0 in 0.344s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:07 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6 Sep 07 14:03:07 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:07 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd.a4fe51af-ed0a-4a53-a4aa-b503c5954ee6" returned: 0 in 0.235s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Lock "cinder-quobyte-a4fe51af-ed0a-4a53-a4aa-b503c5954ee6" released by "_delete_snapshot" :: held 1.510s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Lock "cinder-quobyte-e3ae6108-8ef6-483a-a1d7-e921045d08cd" released by "delete_snapshot" :: held 1.535s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:07 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Created reservations ['8a9742c1-bf9b-4c63-b9d5-3018d708f0ac', 'c903b0f4-75de-4830-bb5e-f17d4242ffb9', '58e411fa-ba7a-4bea-8b8c-ebb5c92fe1e8', '74967d67-16b9-4cf0-8c31-dff9da2c86be'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Delete snapshot completed successfully. Sep 07 14:03:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb14db25-94c3-4452-99d0-8d7058233a1b tempest-VolumeDependencyTests-362814326 None] Lock "cinder-a4fe51af-ed0a-4a53-a4aa-b503c5954ee6-delete_snapshot" released by "delete_snapshot" :: held 1.671s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Acquiring lock "cinder-e3ae6108-8ef6-483a-a1d7-e921045d08cd-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Lock "cinder-e3ae6108-8ef6-483a-a1d7-e921045d08cd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Acquiring lock "cinder-quobyte-e3ae6108-8ef6-483a-a1d7-e921045d08cd" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Lock "cinder-quobyte-e3ae6108-8ef6-483a-a1d7-e921045d08cd" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7924e1c6-13ce-4f39-9423-6756cbb26729]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:08 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd Sep 07 14:03:08 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:08 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd" returned: 0 in 0.385s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:08 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd Sep 07 14:03:08 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:08 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e3ae6108-8ef6-483a-a1d7-e921045d08cd" returned: 0 in 0.250s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Lock "cinder-quobyte-e3ae6108-8ef6-483a-a1d7-e921045d08cd" released by "delete_volume" :: held 0.690s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Created reservations ['3bbd84ef-fc2d-4ebc-bfc6-a0b9e9695b21', '2ca64897-94bb-4209-a9f3-33a4dcffedd6', 'b690ecfe-a720-45f4-9778-0df6292a64be', 'd3031b49-d245-47ae-800f-246aa1e39f1d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:08 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:03:08 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:08 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.247s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:08 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Deleted volume successfully. Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-444ebb1f-0cde-42c9-853c-22c298c18e8d tempest-VolumeDependencyTests-362814326 None] Lock "cinder-e3ae6108-8ef6-483a-a1d7-e921045d08cd-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Acquiring lock "cinder-e8680131-f91e-4e72-b8c1-38f493ea071e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Lock "cinder-e8680131-f91e-4e72-b8c1-38f493ea071e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Acquiring lock "cinder-quobyte-e8680131-f91e-4e72-b8c1-38f493ea071e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Lock "cinder-quobyte-e8680131-f91e-4e72-b8c1-38f493ea071e" acquired by "delete_volume" :: waited 0.013s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8c6d1a-2770-481a-b509-d88b71f72d46]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e8680131-f91e-4e72-b8c1-38f493ea071e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:09 devstack sudo[105711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e8680131-f91e-4e72-b8c1-38f493ea071e Sep 07 14:03:09 devstack sudo[105711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:09 devstack sudo[105711]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e8680131-f91e-4e72-b8c1-38f493ea071e" returned: 0 in 0.362s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e8680131-f91e-4e72-b8c1-38f493ea071e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:09 devstack sudo[105716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e8680131-f91e-4e72-b8c1-38f493ea071e Sep 07 14:03:09 devstack sudo[105716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:09 devstack sudo[105716]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e8680131-f91e-4e72-b8c1-38f493ea071e" returned: 0 in 0.264s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Lock "cinder-quobyte-e8680131-f91e-4e72-b8c1-38f493ea071e" released by "delete_volume" :: held 0.664s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Created reservations ['fa339a39-6b35-4470-8d9f-6efc22c6af1e', '2cdebc9c-52ec-44f4-a75d-fea5601c6dd5', '0d4e22d9-9d1f-48f6-880b-9bf29fdd4a1a', 'bbe34f36-65ea-40ed-9fde-357f376501ba'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:09 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:03:09 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:10 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.237s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:10 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Deleted volume successfully. Sep 07 14:03:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75075034-649c-4dbb-ac6f-a7446675acea tempest-VolumeDependencyTests-362814326 None] Lock "cinder-e8680131-f91e-4e72-b8c1-38f493ea071e-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Flow 'volume_create_manager' (d3835ac2-56eb-43b0-b712-395d69b51a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2018366a-3a96-46e9-9473-2f5249384e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2018366a-3a96-46e9-9473-2f5249384e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2042425428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7929df80-c9de-4ce6-ae2e-c9e3b3026e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f389ad0d66424856a7246ee5c22a545d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:18Z,use_quota=True,user_id='ade3701146bb4bf1b6312d3e09405d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910f7859-7f8f-4ca9-9e12-9a26db2152db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910f7859-7f8f-4ca9-9e12-9a26db2152db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ce0f19-7f09-48fb-bfba-6697deeff099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57ce0f19-7f09-48fb-bfba-6697deeff099) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7929df80-c9de-4ce6-ae2e-c9e3b3026e52', 'volume_name': 'volume-7929df80-c9de-4ce6-ae2e-c9e3b3026e52', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38cfbf05-c126-4577-8eab-bdb67a48aaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38cfbf05-c126-4577-8eab-bdb67a48aaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553f7a0b-1c8c-431a-9d5d-06cb5f99b100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:17 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Volume 7929df80-c9de-4ce6-ae2e-c9e3b3026e52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7929df80-c9de-4ce6-ae2e-c9e3b3026e52', 'volume_size': 1} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2042425428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7929df80-c9de-4ce6-ae2e-c9e3b3026e52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f389ad0d66424856a7246ee5c22a545d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:18Z,use_quota=True,user_id='ade3701146bb4bf1b6312d3e09405d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Creating volume 7929df80-c9de-4ce6-ae2e-c9e3b3026e52 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:17 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7929df80-c9de-4ce6-ae2e-c9e3b3026e52 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:17 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7929df80-c9de-4ce6-ae2e-c9e3b3026e52 1073741824 Sep 07 14:03:17 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:18 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7929df80-c9de-4ce6-ae2e-c9e3b3026e52 1073741824" returned: 0 in 0.436s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7929df80-c9de-4ce6-ae2e-c9e3b3026e52 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:18 devstack sudo[105728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7929df80-c9de-4ce6-ae2e-c9e3b3026e52 Sep 07 14:03:18 devstack sudo[105728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:18 devstack sudo[105728]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7929df80-c9de-4ce6-ae2e-c9e3b3026e52" returned: 0 in 0.266s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553f7a0b-1c8c-431a-9d5d-06cb5f99b100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7929df80-c9de-4ce6-ae2e-c9e3b3026e52', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7554baa0-bfed-4504-818b-eac839c7664b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:18 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Volume volume-7929df80-c9de-4ce6-ae2e-c9e3b3026e52 (7929df80-c9de-4ce6-ae2e-c9e3b3026e52): created successfully Sep 07 14:03:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7554baa0-bfed-4504-818b-eac839c7664b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Flow 'volume_create_manager' (d3835ac2-56eb-43b0-b712-395d69b51a88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-371b918b-3335-4458-8cca-bd951b13522f tempest-ProjectReaderTests-621567965 None] Created volume successfully. Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Acquiring lock "cinder-7929df80-c9de-4ce6-ae2e-c9e3b3026e52-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Lock "cinder-7929df80-c9de-4ce6-ae2e-c9e3b3026e52-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Acquiring lock "cinder-quobyte-7929df80-c9de-4ce6-ae2e-c9e3b3026e52" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Lock "cinder-quobyte-7929df80-c9de-4ce6-ae2e-c9e3b3026e52" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf7427ca-6cf8-4141-8f07-628405e5da4a]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7929df80-c9de-4ce6-ae2e-c9e3b3026e52 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:19 devstack sudo[105731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7929df80-c9de-4ce6-ae2e-c9e3b3026e52 Sep 07 14:03:19 devstack sudo[105731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:19 devstack sudo[105731]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7929df80-c9de-4ce6-ae2e-c9e3b3026e52" returned: 0 in 0.379s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7929df80-c9de-4ce6-ae2e-c9e3b3026e52 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:19 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7929df80-c9de-4ce6-ae2e-c9e3b3026e52 Sep 07 14:03:19 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:19 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-7929df80-c9de-4ce6-ae2e-c9e3b3026e52" returned: 0 in 0.266s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Lock "cinder-quobyte-7929df80-c9de-4ce6-ae2e-c9e3b3026e52" released by "delete_volume" :: held 0.682s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Created reservations ['de8d4e7d-dddc-4434-8e9a-897c4a8b4a0f', '7e00abcb-93fb-4673-a73b-31ae4e7dcd4f', '9c5a0edb-3879-4810-ab0d-789e24983699', '38a7521f-4682-4c95-ba61-16456ad481be'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:19 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:03:19 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:20 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.262s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Deleted volume successfully. Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-65614584-633b-4d89-9908-8a336dcfe344 tempest-ProjectReaderTests-621567965 None] Lock "cinder-7929df80-c9de-4ce6-ae2e-c9e3b3026e52-delete_volume" released by "delete_volume" :: held 1.146s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Flow 'volume_create_manager' (3b9b9e0f-9eef-456a-810f-8d6c8d1ead32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc7777a-87c9-478d-a680-1d8408759801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fc7777a-87c9-478d-a680-1d8408759801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1192738198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee9a93f-68f0-41a0-8664-650fee8d7941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f389ad0d66424856a7246ee5c22a545d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:21Z,use_quota=True,user_id='ade3701146bb4bf1b6312d3e09405d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ef05bc-586d-42e2-b241-3c708c25cbcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ef05bc-586d-42e2-b241-3c708c25cbcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b966222a-81b3-4bd2-9d78-988dfec8b5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b966222a-81b3-4bd2-9d78-988dfec8b5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cee9a93f-68f0-41a0-8664-650fee8d7941', 'volume_name': 'volume-cee9a93f-68f0-41a0-8664-650fee8d7941', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08e846c-de73-4bac-a102-dd6eb8cb6085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a08e846c-de73-4bac-a102-dd6eb8cb6085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbd6462-4338-40e5-b9f9-e142fdf23fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:20 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Volume cee9a93f-68f0-41a0-8664-650fee8d7941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cee9a93f-68f0-41a0-8664-650fee8d7941', 'volume_size': 1} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1192738198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee9a93f-68f0-41a0-8664-650fee8d7941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f389ad0d66424856a7246ee5c22a545d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:21Z,use_quota=True,user_id='ade3701146bb4bf1b6312d3e09405d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Creating volume cee9a93f-68f0-41a0-8664-650fee8d7941 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:20 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cee9a93f-68f0-41a0-8664-650fee8d7941 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:20 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cee9a93f-68f0-41a0-8664-650fee8d7941 1073741824 Sep 07 14:03:20 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:21 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cee9a93f-68f0-41a0-8664-650fee8d7941 1073741824" returned: 0 in 0.435s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cee9a93f-68f0-41a0-8664-650fee8d7941 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:21 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cee9a93f-68f0-41a0-8664-650fee8d7941 Sep 07 14:03:21 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:21 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cee9a93f-68f0-41a0-8664-650fee8d7941" returned: 0 in 0.253s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cbd6462-4338-40e5-b9f9-e142fdf23fa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cee9a93f-68f0-41a0-8664-650fee8d7941', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f0fdd3-4d96-459a-a7de-e1db35a05eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:21 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Volume volume-cee9a93f-68f0-41a0-8664-650fee8d7941 (cee9a93f-68f0-41a0-8664-650fee8d7941): created successfully Sep 07 14:03:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57f0fdd3-4d96-459a-a7de-e1db35a05eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Flow 'volume_create_manager' (3b9b9e0f-9eef-456a-810f-8d6c8d1ead32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d0dc51a4-8e2b-497a-a5ba-cbb1a9442314 tempest-ProjectReaderTests-621567965 None] Created volume successfully. Sep 07 14:03:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Acquiring lock "cinder-cee9a93f-68f0-41a0-8664-650fee8d7941-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Lock "cinder-cee9a93f-68f0-41a0-8664-650fee8d7941-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Acquiring lock "cinder-quobyte-cee9a93f-68f0-41a0-8664-650fee8d7941" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Lock "cinder-quobyte-cee9a93f-68f0-41a0-8664-650fee8d7941" acquired by "delete_volume" :: waited 0.013s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:21 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a499ec76-6571-4068-9d40-ec508fabce2c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cee9a93f-68f0-41a0-8664-650fee8d7941 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:21 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cee9a93f-68f0-41a0-8664-650fee8d7941 Sep 07 14:03:21 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:22 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cee9a93f-68f0-41a0-8664-650fee8d7941" returned: 0 in 0.362s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cee9a93f-68f0-41a0-8664-650fee8d7941 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:22 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cee9a93f-68f0-41a0-8664-650fee8d7941 Sep 07 14:03:22 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:22 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cee9a93f-68f0-41a0-8664-650fee8d7941" returned: 0 in 0.250s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Lock "cinder-quobyte-cee9a93f-68f0-41a0-8664-650fee8d7941" released by "delete_volume" :: held 0.650s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:22 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Created reservations ['69d8585a-0fd4-420a-b17a-4312cea4a1a3', '590c714f-c101-4aff-85e2-904f6b1b3a44', '6acb5dd1-f4c5-4bb4-bba0-64869cf171d0', 'a4e0eed1-981b-470e-a26f-258adca9a647'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:22 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:03:22 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:22 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.241s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:22 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Deleted volume successfully. Sep 07 14:03:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52ea7b75-c084-4107-b97b-427669015efd tempest-ProjectReaderTests-621567965 None] Lock "cinder-cee9a93f-68f0-41a0-8664-650fee8d7941-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Flow 'volume_create_manager' (185e79b5-d8c3-489e-bc74-25791eb10a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860269ed-4372-470e-980f-efce9fbb884d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (860269ed-4372-470e-980f-efce9fbb884d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-941736237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedfd224-0d4b-457d-8028-a79633c8e2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f389ad0d66424856a7246ee5c22a545d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:23Z,use_quota=True,user_id='ade3701146bb4bf1b6312d3e09405d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c3ac09-34ef-42bc-9eb8-e6baf1e27bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c3ac09-34ef-42bc-9eb8-e6baf1e27bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc344bb0-5b76-4965-a8de-d208687bfc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc344bb0-5b76-4965-a8de-d208687bfc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cedfd224-0d4b-457d-8028-a79633c8e2fb', 'volume_name': 'volume-cedfd224-0d4b-457d-8028-a79633c8e2fb', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5729d0fe-b6b9-4953-9ee8-e9aa486d538c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5729d0fe-b6b9-4953-9ee8-e9aa486d538c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a67a35-2262-4792-a987-ddd7d51e519d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:23 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Volume cedfd224-0d4b-457d-8028-a79633c8e2fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cedfd224-0d4b-457d-8028-a79633c8e2fb', 'volume_size': 1} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-941736237',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cedfd224-0d4b-457d-8028-a79633c8e2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f389ad0d66424856a7246ee5c22a545d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:23Z,use_quota=True,user_id='ade3701146bb4bf1b6312d3e09405d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Creating volume cedfd224-0d4b-457d-8028-a79633c8e2fb {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:23 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cedfd224-0d4b-457d-8028-a79633c8e2fb 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:23 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cedfd224-0d4b-457d-8028-a79633c8e2fb 1073741824 Sep 07 14:03:23 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:23 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cedfd224-0d4b-457d-8028-a79633c8e2fb 1073741824" returned: 0 in 0.399s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cedfd224-0d4b-457d-8028-a79633c8e2fb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:23 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cedfd224-0d4b-457d-8028-a79633c8e2fb Sep 07 14:03:23 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:24 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cedfd224-0d4b-457d-8028-a79633c8e2fb" returned: 0 in 0.248s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1a67a35-2262-4792-a987-ddd7d51e519d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cedfd224-0d4b-457d-8028-a79633c8e2fb', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db28599-489b-4da3-9bcb-77398151fa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:24 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Volume volume-cedfd224-0d4b-457d-8028-a79633c8e2fb (cedfd224-0d4b-457d-8028-a79633c8e2fb): created successfully Sep 07 14:03:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5db28599-489b-4da3-9bcb-77398151fa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Flow 'volume_create_manager' (185e79b5-d8c3-489e-bc74-25791eb10a34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4a6bd721-37bd-4ff9-85da-cb72cdb3fd7d tempest-ProjectReaderTests-621567965 None] Created volume successfully. Sep 07 14:03:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Acquiring lock "cinder-cedfd224-0d4b-457d-8028-a79633c8e2fb-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Lock "cinder-cedfd224-0d4b-457d-8028-a79633c8e2fb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Acquiring lock "cinder-quobyte-cedfd224-0d4b-457d-8028-a79633c8e2fb" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Lock "cinder-quobyte-cedfd224-0d4b-457d-8028-a79633c8e2fb" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:24 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ececcf-338e-4b26-b9d1-6ca5c7fa1175]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cedfd224-0d4b-457d-8028-a79633c8e2fb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:24 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cedfd224-0d4b-457d-8028-a79633c8e2fb Sep 07 14:03:24 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:24 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cedfd224-0d4b-457d-8028-a79633c8e2fb" returned: 0 in 0.364s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cedfd224-0d4b-457d-8028-a79633c8e2fb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:24 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cedfd224-0d4b-457d-8028-a79633c8e2fb Sep 07 14:03:24 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:25 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-cedfd224-0d4b-457d-8028-a79633c8e2fb" returned: 0 in 0.242s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Lock "cinder-quobyte-cedfd224-0d4b-457d-8028-a79633c8e2fb" released by "delete_volume" :: held 0.643s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Created reservations ['e594dd3c-d89b-44d0-8444-4ca095c07adf', 'd2e73a80-850d-4b4a-987b-5dd9be1c8a0d', 'f9378089-a0f9-46bd-a0e6-3c72fb2a240a', '16764a9e-95e6-43ed-8788-7bb75dc12de8'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:25 devstack sudo[105781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:03:25 devstack sudo[105781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:25 devstack sudo[105781]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.237s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Deleted volume successfully. Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c8ad4484-5d91-47c7-aec0-f4f24bfb8db8 tempest-ProjectReaderTests-621567965 None] Lock "cinder-cedfd224-0d4b-457d-8028-a79633c8e2fb-delete_volume" released by "delete_volume" :: held 1.071s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Flow 'volume_create_manager' (6943c4ff-c48f-4071-bdcb-4358344e0b81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe5a66b-6b71-470b-a689-16cd5d5efa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe5a66b-6b71-470b-a689-16cd5d5efa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1633252919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887db351-ec2f-400f-be4d-d8cd1e6f8741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f389ad0d66424856a7246ee5c22a545d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:26Z,use_quota=True,user_id='ade3701146bb4bf1b6312d3e09405d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af075494-cf38-48ee-b190-bc4a0d12dffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af075494-cf38-48ee-b190-bc4a0d12dffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6324f580-af0a-4f7d-8422-054c1f759db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6324f580-af0a-4f7d-8422-054c1f759db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '887db351-ec2f-400f-be4d-d8cd1e6f8741', 'volume_name': 'volume-887db351-ec2f-400f-be4d-d8cd1e6f8741', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e99abe-50a5-4252-a02c-98731925fbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07e99abe-50a5-4252-a02c-98731925fbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0772ce57-0a59-4c09-af86-57ff71618546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:26 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Volume 887db351-ec2f-400f-be4d-d8cd1e6f8741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-887db351-ec2f-400f-be4d-d8cd1e6f8741', 'volume_size': 1} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1633252919',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=887db351-ec2f-400f-be4d-d8cd1e6f8741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f389ad0d66424856a7246ee5c22a545d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:26Z,use_quota=True,user_id='ade3701146bb4bf1b6312d3e09405d4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Creating volume 887db351-ec2f-400f-be4d-d8cd1e6f8741 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:26 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-887db351-ec2f-400f-be4d-d8cd1e6f8741 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:26 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-887db351-ec2f-400f-be4d-d8cd1e6f8741 1073741824 Sep 07 14:03:26 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:26 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-887db351-ec2f-400f-be4d-d8cd1e6f8741 1073741824" returned: 0 in 0.383s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-887db351-ec2f-400f-be4d-d8cd1e6f8741 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:26 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-887db351-ec2f-400f-be4d-d8cd1e6f8741 Sep 07 14:03:26 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:26 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-887db351-ec2f-400f-be4d-d8cd1e6f8741" returned: 0 in 0.238s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] <== create_volume: return (660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.664s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0772ce57-0a59-4c09-af86-57ff71618546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-887db351-ec2f-400f-be4d-d8cd1e6f8741', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a57f92-be45-4c56-9e56-235fa1fddb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:26 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Volume volume-887db351-ec2f-400f-be4d-d8cd1e6f8741 (887db351-ec2f-400f-be4d-d8cd1e6f8741): created successfully Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04a57f92-be45-4c56-9e56-235fa1fddb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Flow 'volume_create_manager' (6943c4ff-c48f-4071-bdcb-4358344e0b81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2731b377-850b-40ab-bb43-8292b6506d5e tempest-ProjectReaderTests-621567965 None] Created volume successfully. Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Acquiring lock "cinder-887db351-ec2f-400f-be4d-d8cd1e6f8741-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Lock "cinder-887db351-ec2f-400f-be4d-d8cd1e6f8741-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Acquiring lock "cinder-quobyte-887db351-ec2f-400f-be4d-d8cd1e6f8741" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Lock "cinder-quobyte-887db351-ec2f-400f-be4d-d8cd1e6f8741" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5958f6ce-ef28-4a06-ac27-22948cf582b3]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-887db351-ec2f-400f-be4d-d8cd1e6f8741 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:27 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-887db351-ec2f-400f-be4d-d8cd1e6f8741 Sep 07 14:03:27 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:27 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-887db351-ec2f-400f-be4d-d8cd1e6f8741" returned: 0 in 0.353s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-887db351-ec2f-400f-be4d-d8cd1e6f8741 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:27 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-887db351-ec2f-400f-be4d-d8cd1e6f8741 Sep 07 14:03:27 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:27 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-887db351-ec2f-400f-be4d-d8cd1e6f8741" returned: 0 in 0.248s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Lock "cinder-quobyte-887db351-ec2f-400f-be4d-d8cd1e6f8741" released by "delete_volume" :: held 0.638s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:27 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Created reservations ['b73e6586-5907-41b1-a525-a3f24a069828', 'f2ee2cec-0cd7-4d25-9c20-bfed73a59df1', '67c87864-4d46-4917-b655-a0a2791707ff', 'b7bc4e3d-0005-4036-a513-052188a4ebd5'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:27 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:03:27 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:28 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.237s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:28 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Deleted volume successfully. Sep 07 14:03:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1cb712f9-58df-48e5-8c00-055c183f1b88 tempest-ProjectReaderTests-621567965 None] Lock "cinder-887db351-ec2f-400f-be4d-d8cd1e6f8741-delete_volume" released by "delete_volume" :: held 1.072s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:03:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:29 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:03:29 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:30 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.265s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:03:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 29 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 14:03:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 14:03:37 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=89,cinder:SELECT=58,cinder:INSERT=22,cinder:DELETE=9 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:03:38 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=74,cinder:UPDATE=83,cinder:INSERT=28,cinder:DELETE=6 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Flow 'volume_create_manager' (fe543c67-309b-4433-a819-35d8d97f31b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f8c440-034d-4f42-974f-8f93138fe0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f8c440-034d-4f42-974f-8f93138fe0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-342622429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e60d0fc5-e685-42c3-ad47-acda4fdf7019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef654f19145f40a098808b4d2adb9fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:40Z,use_quota=True,user_id='ccd6bb8c393247cf8414ed551ebdcd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e0764a-6350-4e07-8ca0-6bac5b5f9fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1e0764a-6350-4e07-8ca0-6bac5b5f9fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd37ab3-9b26-4963-bc28-2aa7113ae1e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd37ab3-9b26-4963-bc28-2aa7113ae1e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e60d0fc5-e685-42c3-ad47-acda4fdf7019', 'volume_name': 'volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aafa242c-a95c-4d17-8938-f0b90b24cfbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aafa242c-a95c-4d17-8938-f0b90b24cfbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e69972b-fd4e-4243-9203-3d2af11f2293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:40 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume e60d0fc5-e685-42c3-ad47-acda4fdf7019: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019', 'volume_size': 1} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-342622429',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e60d0fc5-e685-42c3-ad47-acda4fdf7019,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef654f19145f40a098808b4d2adb9fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:40Z,use_quota=True,user_id='ccd6bb8c393247cf8414ed551ebdcd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Creating volume e60d0fc5-e685-42c3-ad47-acda4fdf7019 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:40 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:40 devstack sudo[105846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 1073741824 Sep 07 14:03:40 devstack sudo[105846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Flow 'volume_create_manager' (de2e279a-37f1-4226-9619-9021c6dc446f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160a4c0a-fe5a-4e7a-9e2a-55f019778157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160a4c0a-fe5a-4e7a-9e2a-55f019778157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1917586688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54038ecd-4e53-4359-be2a-023cf4229e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe327cb8dbd4f7e9cbc45dc32bb8bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:41Z,use_quota=True,user_id='39909607d9bb48018224902106951e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef23e532-a1f6-4909-8cca-ab1a40c7241b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef23e532-a1f6-4909-8cca-ab1a40c7241b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c3cb4b-bcdf-4da6-a001-b536997088e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6c3cb4b-bcdf-4da6-a001-b536997088e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54038ecd-4e53-4359-be2a-023cf4229e13', 'volume_name': 'volume-54038ecd-4e53-4359-be2a-023cf4229e13', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fe6fd9-c5ed-40a2-8d53-905acc4f14dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59fe6fd9-c5ed-40a2-8d53-905acc4f14dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88fc7b8-ce25-41b2-a2ee-d2ccfe367777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:41 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Volume 54038ecd-4e53-4359-be2a-023cf4229e13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54038ecd-4e53-4359-be2a-023cf4229e13', 'volume_size': 1} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:41 devstack sudo[105846]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 1073741824" returned: 0 in 0.713s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Flow 'volume_create_manager' (c141320b-21e6-4669-9ac8-690666d90036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ada95df-0739-4a92-8023-81673150d428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ada95df-0739-4a92-8023-81673150d428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1747982067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef126012-a545-4aee-bbf7-ae3656be54a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe327cb8dbd4f7e9cbc45dc32bb8bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:41Z,use_quota=True,user_id='39909607d9bb48018224902106951e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ebb018-2da0-43d3-af60-976cbaaf58b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ebb018-2da0-43d3-af60-976cbaaf58b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:41 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 Sep 07 14:03:41 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684c8100-c763-4f93-9847-a49bc067753b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (684c8100-c763-4f93-9847-a49bc067753b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef126012-a545-4aee-bbf7-ae3656be54a6', 'volume_name': 'volume-ef126012-a545-4aee-bbf7-ae3656be54a6', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4cc06e-7026-47df-a81f-d33855859482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a4cc06e-7026-47df-a81f-d33855859482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb32c2a-5026-49fe-ba6b-9e5d1ceaa6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:41 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Volume ef126012-a545-4aee-bbf7-ae3656be54a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef126012-a545-4aee-bbf7-ae3656be54a6', 'volume_size': 1} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Flow 'volume_create_manager' (62edcee4-feea-48f9-9c97-d88d585aabd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7db2db-0e60-4f78-9b74-09fc6760892d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7db2db-0e60-4f78-9b74-09fc6760892d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a20a51-785d-40ac-978c-cf16778ef72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4df50437e4c247ccaada90a46ce597ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:42Z,use_quota=True,user_id='0470875d23904367b6b6d319b68da679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d2325d-c64d-4088-9a35-a3f85d5d1dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9d2325d-c64d-4088-9a35-a3f85d5d1dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18551458-518a-49ac-b353-cfca55782784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18551458-518a-49ac-b353-cfca55782784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a20a51-785d-40ac-978c-cf16778ef72b', 'volume_name': 'volume-51a20a51-785d-40ac-978c-cf16778ef72b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc576ce-fe75-4315-92f7-0b7b01cd2798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fc576ce-fe75-4315-92f7-0b7b01cd2798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d706b84b-cb9b-4480-89de-b1eda1dfe3fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:41 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Volume 51a20a51-785d-40ac-978c-cf16778ef72b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a20a51-785d-40ac-978c-cf16778ef72b', 'volume_size': 1} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:41 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019" returned: 0 in 0.403s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] <== create_volume: return (1298ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.908s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1917586688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54038ecd-4e53-4359-be2a-023cf4229e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe327cb8dbd4f7e9cbc45dc32bb8bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:41Z,use_quota=True,user_id='39909607d9bb48018224902106951e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Creating volume 54038ecd-4e53-4359-be2a-023cf4229e13 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:41 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54038ecd-4e53-4359-be2a-023cf4229e13 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:41 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54038ecd-4e53-4359-be2a-023cf4229e13 1073741824 Sep 07 14:03:41 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e69972b-fd4e-4243-9203-3d2af11f2293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d5d070-d468-4ae7-849c-813a846190b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:42 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 (e60d0fc5-e685-42c3-ad47-acda4fdf7019): created successfully Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01d5d070-d468-4ae7-849c-813a846190b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Flow 'volume_create_manager' (fe543c67-309b-4433-a819-35d8d97f31b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Flow 'volume_create_manager' (a0029810-baa7-4f3b-9c89-b6510238c507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb278f40-2229-4025-9f8b-e42f28f32151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ff22bdc6-068a-495e-886f-c474d173bc50 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Created volume successfully. Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb278f40-2229-4025-9f8b-e42f28f32151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-466669065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c472b3b0-e0b3-4932-8a98-5a7730f5cf62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe327cb8dbd4f7e9cbc45dc32bb8bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:42Z,use_quota=True,user_id='39909607d9bb48018224902106951e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f1e45b-71b8-4aa2-b877-7c2152e82900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97f1e45b-71b8-4aa2-b877-7c2152e82900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5518b1d-5a09-4e9a-a625-447a99e12eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5518b1d-5a09-4e9a-a625-447a99e12eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c472b3b0-e0b3-4932-8a98-5a7730f5cf62', 'volume_name': 'volume-c472b3b0-e0b3-4932-8a98-5a7730f5cf62', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba511c91-9c72-4fe0-a47f-07f90cf480aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba511c91-9c72-4fe0-a47f-07f90cf480aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db080c5-d934-43e5-97fa-4db1c789ce73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:42 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Volume c472b3b0-e0b3-4932-8a98-5a7730f5cf62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c472b3b0-e0b3-4932-8a98-5a7730f5cf62', 'volume_size': 1} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Flow 'volume_create_manager' (1d2da671-ab32-40b4-bd69-0292d9610e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e537b3e3-1168-4383-986a-1e2d63881192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e537b3e3-1168-4383-986a-1e2d63881192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-191741632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94412e60-48a7-4dcb-92e2-d63b01a3fb2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe327cb8dbd4f7e9cbc45dc32bb8bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:42Z,use_quota=True,user_id='39909607d9bb48018224902106951e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b28263-4a5e-428d-b053-18d2b852c0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19b28263-4a5e-428d-b053-18d2b852c0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f0edf7-64ba-4b4d-ba36-7cc90b08bf04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f0edf7-64ba-4b4d-ba36-7cc90b08bf04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94412e60-48a7-4dcb-92e2-d63b01a3fb2c', 'volume_name': 'volume-94412e60-48a7-4dcb-92e2-d63b01a3fb2c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee24d3d-43c6-44e6-963a-b824920a5152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee24d3d-43c6-44e6-963a-b824920a5152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4602919-fc06-420d-b32a-773d21305f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:42 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Volume 94412e60-48a7-4dcb-92e2-d63b01a3fb2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94412e60-48a7-4dcb-92e2-d63b01a3fb2c', 'volume_size': 1} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:42 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54038ecd-4e53-4359-be2a-023cf4229e13 1073741824" returned: 0 in 0.673s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54038ecd-4e53-4359-be2a-023cf4229e13 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:42 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54038ecd-4e53-4359-be2a-023cf4229e13 Sep 07 14:03:42 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Flow 'volume_create_manager' (0750101e-d5d7-4c89-8998-daace147e986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347e09fb-c16c-42eb-9678-84f7a6355a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (347e09fb-c16c-42eb-9678-84f7a6355a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-434006909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6741476-d74e-4cba-858a-ea76c649a5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe327cb8dbd4f7e9cbc45dc32bb8bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:43Z,use_quota=True,user_id='39909607d9bb48018224902106951e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf2c64f-9c95-4f6b-808e-52c6ee647613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:43 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcf2c64f-9c95-4f6b-808e-52c6ee647613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435670ec-4090-4a06-9eb1-368a2e5dc5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435670ec-4090-4a06-9eb1-368a2e5dc5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6741476-d74e-4cba-858a-ea76c649a5d2', 'volume_name': 'volume-a6741476-d74e-4cba-858a-ea76c649a5d2', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0dc7b5-32e2-4bb8-9899-372839408445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0dc7b5-32e2-4bb8-9899-372839408445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe78110e-2412-47f9-9fcb-dcc7a4c47f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:43 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Volume a6741476-d74e-4cba-858a-ea76c649a5d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6741476-d74e-4cba-858a-ea76c649a5d2', 'volume_size': 1} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54038ecd-4e53-4359-be2a-023cf4229e13" returned: 0 in 0.471s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.543s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1747982067',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef126012-a545-4aee-bbf7-ae3656be54a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe327cb8dbd4f7e9cbc45dc32bb8bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:41Z,use_quota=True,user_id='39909607d9bb48018224902106951e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Creating volume ef126012-a545-4aee-bbf7-ae3656be54a6 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:43 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ef126012-a545-4aee-bbf7-ae3656be54a6 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88fc7b8-ce25-41b2-a2ee-d2ccfe367777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54038ecd-4e53-4359-be2a-023cf4229e13', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:43 devstack sudo[105865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ef126012-a545-4aee-bbf7-ae3656be54a6 1073741824 Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f9ea30-6db3-4ce1-bb4b-165dd9a3cbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:43 devstack sudo[105865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:43 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Volume volume-54038ecd-4e53-4359-be2a-023cf4229e13 (54038ecd-4e53-4359-be2a-023cf4229e13): created successfully Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9f9ea30-6db3-4ce1-bb4b-165dd9a3cbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Flow 'volume_create_manager' (de2e279a-37f1-4226-9619-9021c6dc446f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-03526761-5e5d-4312-820d-42e1b465139f tempest-CreateVolumesFromImageTest-1649622643 None] Created volume successfully. Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:43 devstack sudo[105865]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ef126012-a545-4aee-bbf7-ae3656be54a6 1073741824" returned: 0 in 0.518s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ef126012-a545-4aee-bbf7-ae3656be54a6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:43 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ef126012-a545-4aee-bbf7-ae3656be54a6 Sep 07 14:03:43 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:43 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ef126012-a545-4aee-bbf7-ae3656be54a6" returned: 0 in 0.280s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.179s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a20a51-785d-40ac-978c-cf16778ef72b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4df50437e4c247ccaada90a46ce597ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:42Z,use_quota=True,user_id='0470875d23904367b6b6d319b68da679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Creating volume 51a20a51-785d-40ac-978c-cf16778ef72b {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:44 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51a20a51-785d-40ac-978c-cf16778ef72b 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:44 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51a20a51-785d-40ac-978c-cf16778ef72b 1073741824 Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bb32c2a-5026-49fe-ba6b-9e5d1ceaa6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef126012-a545-4aee-bbf7-ae3656be54a6', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:44 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b15e3b2f-6a89-4601-9415-5b5e0727d947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Volume volume-ef126012-a545-4aee-bbf7-ae3656be54a6 (ef126012-a545-4aee-bbf7-ae3656be54a6): created successfully Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b15e3b2f-6a89-4601-9415-5b5e0727d947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Flow 'volume_create_manager' (c141320b-21e6-4669-9ac8-690666d90036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6f159f50-8940-41d5-a031-7a65954b60ae tempest-CreateVolumesFromImageTest-1649622643 None] Created volume successfully. Sep 07 14:03:44 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51a20a51-785d-40ac-978c-cf16778ef72b 1073741824" returned: 0 in 0.460s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51a20a51-785d-40ac-978c-cf16778ef72b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:44 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51a20a51-785d-40ac-978c-cf16778ef72b Sep 07 14:03:44 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:44 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51a20a51-785d-40ac-978c-cf16778ef72b" returned: 0 in 0.288s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.632s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-466669065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c472b3b0-e0b3-4932-8a98-5a7730f5cf62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe327cb8dbd4f7e9cbc45dc32bb8bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:42Z,use_quota=True,user_id='39909607d9bb48018224902106951e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Creating volume c472b3b0-e0b3-4932-8a98-5a7730f5cf62 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:44 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c472b3b0-e0b3-4932-8a98-5a7730f5cf62 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d706b84b-cb9b-4480-89de-b1eda1dfe3fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a20a51-785d-40ac-978c-cf16778ef72b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:44 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c472b3b0-e0b3-4932-8a98-5a7730f5cf62 1073741824 Sep 07 14:03:44 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d77e5f4-4e4f-4701-96f1-97983a35f50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Volume volume-51a20a51-785d-40ac-978c-cf16778ef72b (51a20a51-785d-40ac-978c-cf16778ef72b): created successfully Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d77e5f4-4e4f-4701-96f1-97983a35f50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Flow 'volume_create_manager' (62edcee4-feea-48f9-9c97-d88d585aabd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-55754e7a-bb08-40ab-b8fc-653c1d912cf3 tempest-CinderUnicodeTest-1425208597 None] Created volume successfully. Sep 07 14:03:45 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c472b3b0-e0b3-4932-8a98-5a7730f5cf62 1073741824" returned: 0 in 0.515s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c472b3b0-e0b3-4932-8a98-5a7730f5cf62 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:45 devstack sudo[105889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c472b3b0-e0b3-4932-8a98-5a7730f5cf62 Sep 07 14:03:45 devstack sudo[105889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Flow 'volume_create_manager' (c74106c1-768f-4247-b9e1-00125bedd086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c02ebe-6491-46cb-8cc8-ae192314fabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c02ebe-6491-46cb-8cc8-ae192314fabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1581d513-b7f5-4a47-9702-17c17c026ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c9583d34a7e4b6c81e847bb1cbb92ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:45Z,use_quota=True,user_id='215d780048d84c27aec1603fc6259653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(976efdd6-c0f3-4172-9e96-8af2109980d3),volume_type_id=976efdd6-c0f3-4172-9e96-8af2109980d3)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd06709-b499-4924-a85a-3d17753a8594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efd06709-b499-4924-a85a-3d17753a8594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5af67a8-cc32-4d8d-9a43-1cbf9ef7f38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 14:03:45 devstack sudo[105889]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c472b3b0-e0b3-4932-8a98-5a7730f5cf62" returned: 0 in 0.288s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.038s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-191741632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94412e60-48a7-4dcb-92e2-d63b01a3fb2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe327cb8dbd4f7e9cbc45dc32bb8bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:42Z,use_quota=True,user_id='39909607d9bb48018224902106951e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Creating volume 94412e60-48a7-4dcb-92e2-d63b01a3fb2c {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:45 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94412e60-48a7-4dcb-92e2-d63b01a3fb2c 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:45 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94412e60-48a7-4dcb-92e2-d63b01a3fb2c 1073741824 Sep 07 14:03:45 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5db080c5-d934-43e5-97fa-4db1c789ce73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c472b3b0-e0b3-4932-8a98-5a7730f5cf62', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d19bf2c-5d07-4fdc-b0f7-695e5cc2df57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5af67a8-cc32-4d8d-9a43-1cbf9ef7f38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1581d513-b7f5-4a47-9702-17c17c026ef8', 'volume_name': 'volume-1581d513-b7f5-4a47-9702-17c17c026ef8', 'volume_size': 1, 'image_id': '94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c1ff448a9fe586729e0dc144fee0554d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c9583d34a7e4b6c81e847bb1cbb92ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '73d9871234907eaf81af036f9f22e2540fa66a595d13a38c93557c3db47c6c4baa53c32c8fd7cc150bf2f05e4926a656693f369964d70021475f1926e68895b9', 'id': '94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be', 'created_at': datetime.datetime(2026, 9, 7, 12, 3, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 3, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132dfc81-2a3b-467f-a0b4-f51a71fd934e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (132dfc81-2a3b-467f-a0b4-f51a71fd934e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc81200-1080-45a8-b1bc-06117bb08b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:45 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Volume 1581d513-b7f5-4a47-9702-17c17c026ef8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1581d513-b7f5-4a47-9702-17c17c026ef8', 'volume_size': 1, 'image_id': '94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c1ff448a9fe586729e0dc144fee0554d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c9583d34a7e4b6c81e847bb1cbb92ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '73d9871234907eaf81af036f9f22e2540fa66a595d13a38c93557c3db47c6c4baa53c32c8fd7cc150bf2f05e4926a656693f369964d70021475f1926e68895b9', 'id': '94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be', 'created_at': datetime.datetime(2026, 9, 7, 12, 3, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 3, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Trying to clone 1581d513-b7f5-4a47-9702-17c17c026ef8 from image 94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be at location (None, [{'url': 'file:///opt/stack/data/glance/images/94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 14:03:45 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Volume volume-c472b3b0-e0b3-4932-8a98-5a7730f5cf62 (c472b3b0-e0b3-4932-8a98-5a7730f5cf62): created successfully Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d19bf2c-5d07-4fdc-b0f7-695e5cc2df57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Flow 'volume_create_manager' (a0029810-baa7-4f3b-9c89-b6510238c507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-689754ad-6ae1-4a68-81a7-79027ab22c10 tempest-CreateVolumesFromImageTest-1649622643 None] Created volume successfully. Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 14:03:45 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Image download 0.00 MB at 0.00 MB/s Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0329eecc-f983-41f4-8fc1-100d622fa6f4]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:46 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD Sep 07 14:03:46 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:46 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94412e60-48a7-4dcb-92e2-d63b01a3fb2c 1073741824" returned: 0 in 0.476s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94412e60-48a7-4dcb-92e2-d63b01a3fb2c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:46 devstack sudo[105900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94412e60-48a7-4dcb-92e2-d63b01a3fb2c Sep 07 14:03:46 devstack sudo[105900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:46 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD" returned: 0 in 0.400s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:46 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD Sep 07 14:03:46 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Flow 'volume_create_manager' (8f8539fa-2f76-4e1f-969e-9c5cfb73d229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf770fbc-57e4-4174-84d0-d03403be7105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:46 devstack sudo[105900]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94412e60-48a7-4dcb-92e2-d63b01a3fb2c" returned: 0 in 0.323s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.396s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-434006909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6741476-d74e-4cba-858a-ea76c649a5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffe327cb8dbd4f7e9cbc45dc32bb8bce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:43Z,use_quota=True,user_id='39909607d9bb48018224902106951e3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Creating volume a6741476-d74e-4cba-858a-ea76c649a5d2 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:46 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a6741476-d74e-4cba-858a-ea76c649a5d2 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf770fbc-57e4-4174-84d0-d03403be7105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1469033795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49b66e0-9d94-4503-859b-02b318c2d050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4df50437e4c247ccaada90a46ce597ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:46Z,use_quota=True,user_id='0470875d23904367b6b6d319b68da679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:46 devstack sudo[105907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a6741476-d74e-4cba-858a-ea76c649a5d2 1073741824 Sep 07 14:03:46 devstack sudo[105907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e28d0f-1be1-4638-81f2-122f7ffb79a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22e28d0f-1be1-4638-81f2-122f7ffb79a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48309656-b455-4a3f-ad61-38be009e3849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48309656-b455-4a3f-ad61-38be009e3849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd49b66e0-9d94-4503-859b-02b318c2d050', 'volume_name': 'volume-d49b66e0-9d94-4503-859b-02b318c2d050', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac84b12-a271-4299-9638-4e0f58615137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac84b12-a271-4299-9638-4e0f58615137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47fc7fe0-5621-44fc-82bd-59a47957ac69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:46 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Volume d49b66e0-9d94-4503-859b-02b318c2d050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d49b66e0-9d94-4503-859b-02b318c2d050', 'volume_size': 1} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4602919-fc06-420d-b32a-773d21305f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94412e60-48a7-4dcb-92e2-d63b01a3fb2c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c21e65-c832-4774-b31a-6c278ab84039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:46 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Volume volume-94412e60-48a7-4dcb-92e2-d63b01a3fb2c (94412e60-48a7-4dcb-92e2-d63b01a3fb2c): created successfully Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8c21e65-c832-4774-b31a-6c278ab84039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Flow 'volume_create_manager' (1d2da671-ab32-40b4-bd69-0292d9610e20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:46 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a0dd4756-3a5b-412f-87f6-5e4b18363ad4 tempest-CreateVolumesFromImageTest-1649622643 None] Created volume successfully. Sep 07 14:03:46 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD" returned: 1 in 0.386s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Temporary image 94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be is fetched for user 215d780048d84c27aec1603fc6259653. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b9e671-cf8c-4419-bfc0-1e7537f26b16]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:46 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD Sep 07 14:03:46 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:46 devstack sudo[105907]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a6741476-d74e-4cba-858a-ea76c649a5d2 1073741824" returned: 0 in 0.441s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a6741476-d74e-4cba-858a-ea76c649a5d2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:47 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a6741476-d74e-4cba-858a-ea76c649a5d2 Sep 07 14:03:47 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:47 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:47 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD Sep 07 14:03:47 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:47 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a6741476-d74e-4cba-858a-ea76c649a5d2" returned: 0 in 0.260s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] <== create_volume: return (747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.029s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe78110e-2412-47f9-9fcb-dcc7a4c47f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6741476-d74e-4cba-858a-ea76c649a5d2', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ba5b5a-e1ec-4fad-9a74-150edc680f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Creating offline snapshot 67f62ffd-12f1-4669-ac5d-9552fec21453 of volume e60d0fc5-e685-42c3-ad47-acda4fdf7019 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:03:47 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Volume volume-a6741476-d74e-4cba-858a-ea76c649a5d2 (a6741476-d74e-4cba-858a-ea76c649a5d2): created successfully Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0ba5b5a-e1ec-4fad-9a74-150edc680f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Flow 'volume_create_manager' (0750101e-d5d7-4c89-8998-daace147e986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbd4d26-cee5-4a1f-b8a2-b196d43b9809]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c68b2f0c-e780-4b87-9945-dd29eaf13ede tempest-CreateVolumesFromImageTest-1649622643 None] Created volume successfully. Sep 07 14:03:47 devstack sudo[105925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 Sep 07 14:03:47 devstack sudo[105925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:47 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD" returned: 1 in 0.392s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "cinder-a6741476-d74e-4cba-858a-ea76c649a5d2-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-a6741476-d74e-4cba-858a-ea76c649a5d2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "cinder-quobyte-a6741476-d74e-4cba-858a-ea76c649a5d2" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-quobyte-a6741476-d74e-4cba-858a-ea76c649a5d2" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[add2e181-b351-42b0-b0c8-cb6b31dbaf29]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a6741476-d74e-4cba-858a-ea76c649a5d2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:47 devstack sudo[105925]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019" returned: 0 in 0.457s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:47 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453 1G Sep 07 14:03:47 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:47 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a6741476-d74e-4cba-858a-ea76c649a5d2 Sep 07 14:03:47 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:48 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a6741476-d74e-4cba-858a-ea76c649a5d2" returned: 0 in 0.421s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a6741476-d74e-4cba-858a-ea76c649a5d2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:48 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a6741476-d74e-4cba-858a-ea76c649a5d2 Sep 07 14:03:48 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:48 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453 1G" returned: 0 in 0.413s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:48 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453 Sep 07 14:03:48 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:48 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a6741476-d74e-4cba-858a-ea76c649a5d2" returned: 0 in 0.281s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-quobyte-a6741476-d74e-4cba-858a-ea76c649a5d2" released by "delete_volume" :: held 0.766s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Created reservations ['8479f054-3250-4f9d-823d-8a24eb65c454', '1f731dca-b515-4800-bb8b-a1ec70dbb416', 'ea4bfc4c-2111-4321-8740-ea5e4947730a', '8eebe18d-ef54-4264-ad55-d66fd80d1532'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:48 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453" returned: 0 in 0.339s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:48 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453 is being set with open permissions: ugo+rw Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:48 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453 Sep 07 14:03:48 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:48 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:03:48 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "cinder-94412e60-48a7-4dcb-92e2-d63b01a3fb2c-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-94412e60-48a7-4dcb-92e2-d63b01a3fb2c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:48 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453" returned: 0 in 0.364s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "cinder-quobyte-94412e60-48a7-4dcb-92e2-d63b01a3fb2c" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-quobyte-94412e60-48a7-4dcb-92e2-d63b01a3fb2c" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:48 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.348s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7852c7b1-e02d-422a-8442-c5b417bc5ef7]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94412e60-48a7-4dcb-92e2-d63b01a3fb2c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Deleted volume successfully. Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3c01c847-db83-492b-b481-262416dbe944 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-a6741476-d74e-4cba-858a-ea76c649a5d2-delete_volume" released by "delete_volume" :: held 1.426s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:49 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.info Sep 07 14:03:49 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:49 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94412e60-48a7-4dcb-92e2-d63b01a3fb2c Sep 07 14:03:49 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:49 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.info" returned: 0 in 0.264s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:49 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.info is being set with open permissions: ugo+rw Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:49 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.info Sep 07 14:03:49 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:49 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94412e60-48a7-4dcb-92e2-d63b01a3fb2c" returned: 0 in 0.416s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94412e60-48a7-4dcb-92e2-d63b01a3fb2c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:49 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94412e60-48a7-4dcb-92e2-d63b01a3fb2c Sep 07 14:03:49 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:49 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.info" returned: 0 in 0.277s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.320s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.993s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1469033795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d49b66e0-9d94-4503-859b-02b318c2d050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4df50437e4c247ccaada90a46ce597ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:46Z,use_quota=True,user_id='0470875d23904367b6b6d319b68da679',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Creating volume d49b66e0-9d94-4503-859b-02b318c2d050 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:49 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:49 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050 1073741824 Sep 07 14:03:49 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4ffd0f83-991e-477d-bc87-61c358f31cf3 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Create snapshot completed successfully Sep 07 14:03:49 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-94412e60-48a7-4dcb-92e2-d63b01a3fb2c" returned: 0 in 0.299s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-quobyte-94412e60-48a7-4dcb-92e2-d63b01a3fb2c" released by "delete_volume" :: held 0.766s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Created reservations ['3b122f45-1511-4817-956c-7bb0465c4066', '3f2d4b4d-a37c-4533-a9df-ef6f6d30f6d0', 'a398c21e-eafd-4b58-a7ba-092ba1f0050d', '693e4208-74ed-4f91-be1e-312c9d52de89'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:49 devstack sudo[106011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:03:49 devstack sudo[106011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "cinder-c472b3b0-e0b3-4932-8a98-5a7730f5cf62-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-c472b3b0-e0b3-4932-8a98-5a7730f5cf62-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "cinder-quobyte-c472b3b0-e0b3-4932-8a98-5a7730f5cf62" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-quobyte-c472b3b0-e0b3-4932-8a98-5a7730f5cf62" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:50 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050 1073741824" returned: 0 in 0.514s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[733fda55-3429-4040-b927-8be267ef7112]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c472b3b0-e0b3-4932-8a98-5a7730f5cf62 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:50 devstack sudo[106011]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.322s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Deleted volume successfully. Sep 07 14:03:50 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050 Sep 07 14:03:50 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-352b0a4a-0d02-49db-988d-b1edb468caa7 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-94412e60-48a7-4dcb-92e2-d63b01a3fb2c-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:50 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c472b3b0-e0b3-4932-8a98-5a7730f5cf62 Sep 07 14:03:50 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:50 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050" returned: 0 in 0.279s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.944s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1581d513-b7f5-4a47-9702-17c17c026ef8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c9583d34a7e4b6c81e847bb1cbb92ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:45Z,use_quota=True,user_id='215d780048d84c27aec1603fc6259653',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(976efdd6-c0f3-4172-9e96-8af2109980d3),volume_type_id=976efdd6-c0f3-4172-9e96-8af2109980d3)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Creating volume 1581d513-b7f5-4a47-9702-17c17c026ef8 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:50 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47fc7fe0-5621-44fc-82bd-59a47957ac69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d49b66e0-9d94-4503-859b-02b318c2d050', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5437689-0f67-4426-9e83-076327be8029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:50 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8 1073741824 Sep 07 14:03:50 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:50 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Volume volume-d49b66e0-9d94-4503-859b-02b318c2d050 (d49b66e0-9d94-4503-859b-02b318c2d050): created successfully Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5437689-0f67-4426-9e83-076327be8029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:50 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Flow 'volume_create_manager' (8f8539fa-2f76-4e1f-969e-9c5cfb73d229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c472b3b0-e0b3-4932-8a98-5a7730f5cf62" returned: 0 in 0.447s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c472b3b0-e0b3-4932-8a98-5a7730f5cf62 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fe336783-9bac-4c23-ac8e-9a7fd5a447e8 tempest-CinderUnicodeTest-1425208597 None] Created volume successfully. Sep 07 14:03:50 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c472b3b0-e0b3-4932-8a98-5a7730f5cf62 Sep 07 14:03:50 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:50 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c472b3b0-e0b3-4932-8a98-5a7730f5cf62" returned: 0 in 0.292s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-quobyte-c472b3b0-e0b3-4932-8a98-5a7730f5cf62" released by "delete_volume" :: held 0.785s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:50 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Created reservations ['a7abf6a9-022e-4b2b-a85f-c961b9fae6cb', 'b78d123a-5bab-4dc4-b928-c30d2002b5ee', '0c9d38a4-bd4f-4cc7-9351-041bcef2208d', 'dbddb6bd-920f-4a70-8803-d7ddbb4af343'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:51 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8 1073741824" returned: 0 in 0.614s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:51 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:03:51 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:51 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8 Sep 07 14:03:51 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Flow 'volume_create_manager' (d00ef847-4c45-4733-8496-abf6576bc6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176545c1-3cc3-4304-a05c-6a095460bfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "cinder-ef126012-a545-4aee-bbf7-ae3656be54a6-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (176545c1-3cc3-4304-a05c-6a095460bfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1748159286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009a02c9-8423-4258-9e0e-79c025cd11ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef654f19145f40a098808b4d2adb9fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:51Z,use_quota=True,user_id='ccd6bb8c393247cf8414ed551ebdcd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f231e9-a5bb-40db-8a57-5ecc5b6e5334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f231e9-a5bb-40db-8a57-5ecc5b6e5334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e286105-ab6e-464a-b67e-3234c62ec9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e286105-ab6e-464a-b67e-3234c62ec9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '009a02c9-8423-4258-9e0e-79c025cd11ed', 'volume_name': 'volume-009a02c9-8423-4258-9e0e-79c025cd11ed', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a61944-d9b5-4572-b143-7412941d9dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a61944-d9b5-4572-b143-7412941d9dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462fafbb-83bf-48b6-9434-81e7f55e1948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:51 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume 009a02c9-8423-4258-9e0e-79c025cd11ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-009a02c9-8423-4258-9e0e-79c025cd11ed', 'volume_size': 1} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-ef126012-a545-4aee-bbf7-ae3656be54a6-delete_volume" acquired by "delete_volume" :: waited 0.097s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "cinder-quobyte-ef126012-a545-4aee-bbf7-ae3656be54a6" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-quobyte-ef126012-a545-4aee-bbf7-ae3656be54a6" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:51 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cde1a2-7a31-4364-9c0b-44321de1f525]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ef126012-a545-4aee-bbf7-ae3656be54a6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:51 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.434s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:51 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Deleted volume successfully. Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8" returned: 0 in 0.397s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.080s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.193s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1748159286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009a02c9-8423-4258-9e0e-79c025cd11ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef654f19145f40a098808b4d2adb9fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:51Z,use_quota=True,user_id='ccd6bb8c393247cf8414ed551ebdcd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Creating volume 009a02c9-8423-4258-9e0e-79c025cd11ed {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:51 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-009a02c9-8423-4258-9e0e-79c025cd11ed 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-deba63c5-1a6e-4ffd-9e74-ecf8ff5f0228 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-c472b3b0-e0b3-4932-8a98-5a7730f5cf62-delete_volume" released by "delete_volume" :: held 1.575s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:51 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-009a02c9-8423-4258-9e0e-79c025cd11ed 1073741824 Sep 07 14:03:51 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Attempting download of 94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be ((None, [{'url': 'file:///opt/stack/data/glance/images/94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be', 'metadata': {}}])) to volume 1581d513-b7f5-4a47-9702-17c17c026ef8. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 14:03:51 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ef126012-a545-4aee-bbf7-ae3656be54a6 Sep 07 14:03:51 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5fc1cf-a327-427f-b359-39bddbce2903]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_7swuz2i7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Flow 'volume_create_manager' (cd4e2722-82b1-42be-8766-afff09945c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:52 devstack sudo[106042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_7swuz2i7 Sep 07 14:03:52 devstack sudo[106042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff45fb12-5002-425e-a318-787704a41f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff45fb12-5002-425e-a318-787704a41f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1413157639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eea5cd5-cb42-447d-8f3f-458be9174b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef654f19145f40a098808b4d2adb9fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:52Z,use_quota=True,user_id='ccd6bb8c393247cf8414ed551ebdcd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:52 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8365450-42e9-45a8-ba1b-c979c9a0af7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8365450-42e9-45a8-ba1b-c979c9a0af7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e65911f-7522-480e-8a3f-3556d47777aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e65911f-7522-480e-8a3f-3556d47777aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1eea5cd5-cb42-447d-8f3f-458be9174b29', 'volume_name': 'volume-1eea5cd5-cb42-447d-8f3f-458be9174b29', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a0984c-38b3-4a9c-8947-b79ec1f81a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95a0984c-38b3-4a9c-8947-b79ec1f81a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb904b79-4d88-4872-9d2c-5ebc2e2c71c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:52 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume 1eea5cd5-cb42-447d-8f3f-458be9174b29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1eea5cd5-cb42-447d-8f3f-458be9174b29', 'volume_size': 1} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ef126012-a545-4aee-bbf7-ae3656be54a6" returned: 0 in 0.619s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ef126012-a545-4aee-bbf7-ae3656be54a6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:52 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ef126012-a545-4aee-bbf7-ae3656be54a6 Sep 07 14:03:52 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:52 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-009a02c9-8423-4258-9e0e-79c025cd11ed 1073741824" returned: 0 in 0.807s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:52 devstack sudo[106042]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_7swuz2i7" returned: 0 in 0.641s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_7swuz2i7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-009a02c9-8423-4258-9e0e-79c025cd11ed {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:52 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-009a02c9-8423-4258-9e0e-79c025cd11ed Sep 07 14:03:52 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Flow 'volume_create_manager' (b4252aed-ab2a-487b-b2e6-df169a8a3fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf6251f-ef40-48fc-b119-d7e5784951ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:52 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-ef126012-a545-4aee-bbf7-ae3656be54a6" returned: 0 in 0.494s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:52 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_7swuz2i7 Sep 07 14:03:52 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf6251f-ef40-48fc-b119-d7e5784951ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1760450664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac08ca5-22c1-4e7a-bfd1-9a234eec713b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef654f19145f40a098808b4d2adb9fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:53Z,use_quota=True,user_id='ccd6bb8c393247cf8414ed551ebdcd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bb521ee-bf19-46e2-8b69-0e23d4f0eee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bb521ee-bf19-46e2-8b69-0e23d4f0eee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18493d42-0591-4eaa-95c9-87be889f7436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18493d42-0591-4eaa-95c9-87be889f7436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ac08ca5-22c1-4e7a-bfd1-9a234eec713b', 'volume_name': 'volume-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e8a0e5-b786-42e5-8efe-9c278939ed8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25e8a0e5-b786-42e5-8efe-9c278939ed8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57d2f78-ac90-497a-b050-54a851389474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:52 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume 8ac08ca5-22c1-4e7a-bfd1-9a234eec713b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b', 'volume_size': 1} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-quobyte-ef126012-a545-4aee-bbf7-ae3656be54a6" released by "delete_volume" :: held 1.245s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Created reservations ['cda05499-eebb-48c6-9a3a-fc20f71fe8da', 'd0b4b05c-73f8-4f60-b065-5d0ec6e55cde', 'b2082b11-4d32-4d26-ba83-4ef0e8ccc7f1', 'b9e4083f-de5a-4ca3-b4f6-36d75d5c4582'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:52 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-009a02c9-8423-4258-9e0e-79c025cd11ed" returned: 0 in 0.400s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.317s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.764s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1413157639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1eea5cd5-cb42-447d-8f3f-458be9174b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef654f19145f40a098808b4d2adb9fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:52Z,use_quota=True,user_id='ccd6bb8c393247cf8414ed551ebdcd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Creating volume 1eea5cd5-cb42-447d-8f3f-458be9174b29 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:52 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1eea5cd5-cb42-447d-8f3f-458be9174b29 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:52 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1eea5cd5-cb42-447d-8f3f-458be9174b29 1073741824 Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (462fafbb-83bf-48b6-9434-81e7f55e1948) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-009a02c9-8423-4258-9e0e-79c025cd11ed', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53902f4-5220-4843-963f-3302d42531a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:52 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume volume-009a02c9-8423-4258-9e0e-79c025cd11ed (009a02c9-8423-4258-9e0e-79c025cd11ed): created successfully Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d53902f4-5220-4843-963f-3302d42531a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Flow 'volume_create_manager' (d00ef847-4c45-4733-8496-abf6576bc6d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:53 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_7swuz2i7" returned: 1 in 0.613s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_7swuz2i7' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcb5e673-e2d2-46ff-b891-c08e05cf532b]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b0f088c4-6bac-4aae-90e6-35ed1e7e08d6 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Created volume successfully. Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:53 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:03:53 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:53 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD Sep 07 14:03:53 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Flow 'volume_create_manager' (14894307-d141-4679-b26d-d036b901b7e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e87e2a-a560-4e71-a6b4-cab951e6c983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42e87e2a-a560-4e71-a6b4-cab951e6c983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-209469257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef654f19145f40a098808b4d2adb9fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:53Z,use_quota=True,user_id='ccd6bb8c393247cf8414ed551ebdcd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4129d0a-7d8b-4bc7-bc49-1c10e54acc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4129d0a-7d8b-4bc7-bc49-1c10e54acc05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202c050f-6463-4ae1-8a39-b6c26be2f189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (202c050f-6463-4ae1-8a39-b6c26be2f189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d', 'volume_name': 'volume-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0486444-514c-424b-a11b-60da49e5642b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0486444-514c-424b-a11b-60da49e5642b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806fc272-2eca-41e4-84ae-df887e6fe305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume 2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d', 'volume_size': 1} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:53 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.479s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Deleted volume successfully. Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-587c25a9-011f-4c5b-8b9d-35868c08660b tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-ef126012-a545-4aee-bbf7-ae3656be54a6-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:53 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD" returned: 0 in 0.624s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "cinder-54038ecd-4e53-4359-be2a-023cf4229e13-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Flow 'volume_create_manager' (969c9e07-55da-410d-a4ec-fadff882fe0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e826fd5-503b-46b3-bee7-53679e07c974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-54038ecd-4e53-4359-be2a-023cf4229e13-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e826fd5-503b-46b3-bee7-53679e07c974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1551982662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c376c69-9899-475d-92ba-91c7fc27ad4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef654f19145f40a098808b4d2adb9fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:54Z,use_quota=True,user_id='ccd6bb8c393247cf8414ed551ebdcd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781296e8-bd9e-473c-b988-e425f92b57ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:53 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (781296e8-bd9e-473c-b988-e425f92b57ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c082cf-eaf0-45f8-bf15-748b83b428be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80c082cf-eaf0-45f8-bf15-748b83b428be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c376c69-9899-475d-92ba-91c7fc27ad4e', 'volume_name': 'volume-0c376c69-9899-475d-92ba-91c7fc27ad4e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f0ecd4-2370-4c71-a612-32cef02f9634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f0ecd4-2370-4c71-a612-32cef02f9634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e5d3c9-5d78-406b-a148-2669446e617d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume 0c376c69-9899-475d-92ba-91c7fc27ad4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c376c69-9899-475d-92ba-91c7fc27ad4e', 'volume_size': 1} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1eea5cd5-cb42-447d-8f3f-458be9174b29 1073741824" returned: 0 in 0.898s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:53 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD Sep 07 14:03:53 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "cinder-quobyte-54038ecd-4e53-4359-be2a-023cf4229e13" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1eea5cd5-cb42-447d-8f3f-458be9174b29 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-quobyte-54038ecd-4e53-4359-be2a-023cf4229e13" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:53 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1eea5cd5-cb42-447d-8f3f-458be9174b29 Sep 07 14:03:53 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b2c1c1-91b7-4eff-b02b-af767c6db9a1]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54038ecd-4e53-4359-be2a-023cf4229e13 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:54 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54038ecd-4e53-4359-be2a-023cf4229e13 Sep 07 14:03:54 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:54 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD" returned: 1 in 0.387s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] 94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be was raw, converting to qcow2 {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:54 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8 Sep 07 14:03:54 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:54 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1eea5cd5-cb42-447d-8f3f-458be9174b29" returned: 0 in 0.288s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] <== create_volume: return (1237ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.810s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb904b79-4d88-4872-9d2c-5ebc2e2c71c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1eea5cd5-cb42-447d-8f3f-458be9174b29', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a76d1e-5ff1-42db-bdc3-2ce9c0df9d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] Creating offline snapshot 39eb2dfa-8d03-4397-883d-fa225be79099 of volume d49b66e0-9d94-4503-859b-02b318c2d050 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:03:54 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume volume-1eea5cd5-cb42-447d-8f3f-458be9174b29 (1eea5cd5-cb42-447d-8f3f-458be9174b29): created successfully Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a76d1e-5ff1-42db-bdc3-2ce9c0df9d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Flow 'volume_create_manager' (cd4e2722-82b1-42be-8766-afff09945c3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea8cf282-bd5f-4357-a422-446671404394]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-12cc3e83-7fb9-49a2-b919-20eaf9622f26 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Created volume successfully. Sep 07 14:03:54 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54038ecd-4e53-4359-be2a-023cf4229e13" returned: 0 in 0.424s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54038ecd-4e53-4359-be2a-023cf4229e13 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:54 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050 Sep 07 14:03:54 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:54 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54038ecd-4e53-4359-be2a-023cf4229e13 Sep 07 14:03:54 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:54 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54038ecd-4e53-4359-be2a-023cf4229e13" returned: 0 in 0.309s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:54 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050" returned: 0 in 0.451s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:54 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-quobyte-54038ecd-4e53-4359-be2a-023cf4229e13" released by "delete_volume" :: held 0.815s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8" returned: 0 in 0.623s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be_26zy0e26devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 14:03:54 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:54 devstack sudo[106103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099 1G Sep 07 14:03:54 devstack sudo[106103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:54 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8 1G Sep 07 14:03:54 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Created reservations ['e919b75a-e6d4-467f-82f2-684e81ce8afa', '878d56b9-eef3-48db-936d-2a50c2bc0a83', '4e27c989-ff3d-49e0-9064-f134c27a6085', 'cc68f7fb-3ab2-416e-a33b-5b1cd1aac4ca'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:54 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:03:54 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:55 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8 1G" returned: 0 in 0.343s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Downloaded image 94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be ((None, [{'url': 'file:///opt/stack/data/glance/images/94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be', 'metadata': {}}])) to volume 1581d513-b7f5-4a47-9702-17c17c026ef8 successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Temporary image 94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be for user 215d780048d84c27aec1603fc6259653 is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Marking volume 1581d513-b7f5-4a47-9702-17c17c026ef8 as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Copying metadata from image 94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be to 1581d513-b7f5-4a47-9702-17c17c026ef8. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Creating volume glance metadata for volume 1581d513-b7f5-4a47-9702-17c17c026ef8 backed by image 94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c1ff448a9fe586729e0dc144fee0554d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cc81200-1080-45a8-b1bc-06117bb08b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1581d513-b7f5-4a47-9702-17c17c026ef8', 'volume_size': 1, 'image_id': '94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c1ff448a9fe586729e0dc144fee0554d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c9583d34a7e4b6c81e847bb1cbb92ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '73d9871234907eaf81af036f9f22e2540fa66a595d13a38c93557c3db47c6c4baa53c32c8fd7cc150bf2f05e4926a656693f369964d70021475f1926e68895b9', 'id': '94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be', 'created_at': datetime.datetime(2026, 9, 7, 12, 3, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 3, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/94c5297d-f1fc-4602-a3fd-0d1bcf6fb7be/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf275733-8a0c-4a0b-b41c-0b0bf0c007f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:55 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Volume volume-1581d513-b7f5-4a47-9702-17c17c026ef8 (1581d513-b7f5-4a47-9702-17c17c026ef8): created successfully Sep 07 14:03:55 devstack sudo[106103]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf275733-8a0c-4a0b-b41c-0b0bf0c007f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Flow 'volume_create_manager' (c74106c1-768f-4247-b9e1-00125bedd086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099 1G" returned: 0 in 0.490s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49b66e0-9d94-4503-859b-02b318c2d050 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:55 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.336s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:55 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Deleted volume successfully. Sep 07 14:03:55 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49b66e0-9d94-4503-859b-02b318c2d050 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099 Sep 07 14:03:55 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:55 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a07c4298-95ca-4083-84e5-c8c6b8702ce0 tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Created volume successfully. Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-737bff05-1d31-4206-8fac-89a5a91df8c8 tempest-CreateVolumesFromImageTest-1649622643 None] Lock "cinder-54038ecd-4e53-4359-be2a-023cf4229e13-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:55 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d49b66e0-9d94-4503-859b-02b318c2d050 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099" returned: 0 in 0.329s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:55 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099 is being set with open permissions: ugo+rw Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:55 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099 Sep 07 14:03:55 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:55 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099" returned: 0 in 0.243s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:55 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.info Sep 07 14:03:55 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:56 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.info" returned: 0 in 0.282s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:56 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.info is being set with open permissions: ugo+rw Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:56 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.info Sep 07 14:03:56 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Acquiring lock "cinder-1581d513-b7f5-4a47-9702-17c17c026ef8-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Lock "cinder-1581d513-b7f5-4a47-9702-17c17c026ef8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Acquiring lock "cinder-quobyte-1581d513-b7f5-4a47-9702-17c17c026ef8" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Lock "cinder-quobyte-1581d513-b7f5-4a47-9702-17c17c026ef8" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f660eb2-7895-428b-9d88-ba46b5bcb7b7]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:56 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.info" returned: 0 in 0.318s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.256s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.689s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1760450664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ac08ca5-22c1-4e7a-bfd1-9a234eec713b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef654f19145f40a098808b4d2adb9fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:53Z,use_quota=True,user_id='ccd6bb8c393247cf8414ed551ebdcd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Creating volume 8ac08ca5-22c1-4e7a-bfd1-9a234eec713b {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:56 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:56 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b 1073741824 Sep 07 14:03:56 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:56 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c4fcfde2-b1a4-49ac-b238-8514f2409c7d tempest-CinderUnicodeTest-1425208597 None] Create snapshot completed successfully Sep 07 14:03:56 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8 Sep 07 14:03:56 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:56 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8" returned: 0 in 0.448s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:56 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8 Sep 07 14:03:56 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:56 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b 1073741824" returned: 0 in 0.575s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:57 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1581d513-b7f5-4a47-9702-17c17c026ef8" returned: 0 in 0.264s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:57 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b Sep 07 14:03:57 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Lock "cinder-quobyte-1581d513-b7f5-4a47-9702-17c17c026ef8" released by "delete_volume" :: held 0.767s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Created reservations ['38ee6b9f-81ac-452f-81f2-ad0f62d4c665', 'c81928bd-bdc5-4285-9825-ac327878c7e1', '04450ccf-111e-4dbd-86c5-ddbddd693484', '473f215c-911c-42ff-ab37-1ece1990330d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:57 devstack sudo[106149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:03:57 devstack sudo[106149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:57 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b" returned: 0 in 0.250s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.805s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-209469257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef654f19145f40a098808b4d2adb9fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:53Z,use_quota=True,user_id='ccd6bb8c393247cf8414ed551ebdcd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Creating volume 2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:57 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57d2f78-ac90-497a-b050-54a851389474) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010a21e7-41d2-49aa-a14a-1aca3fadc380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:57 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d 1073741824 Sep 07 14:03:57 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:57 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume volume-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b (8ac08ca5-22c1-4e7a-bfd1-9a234eec713b): created successfully Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (010a21e7-41d2-49aa-a14a-1aca3fadc380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Flow 'volume_create_manager' (b4252aed-ab2a-487b-b2e6-df169a8a3fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dfe1a058-809e-4b3b-b0f0-7bafc807b9cb tempest-CreateVolumesFromSnapshotTest-1459555228 None] Created volume successfully. Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Acquiring lock "cinder-39eb2dfa-8d03-4397-883d-fa225be79099-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Lock "cinder-39eb2dfa-8d03-4397-883d-fa225be79099-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Acquiring lock "cinder-quobyte-d49b66e0-9d94-4503-859b-02b318c2d050" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Lock "cinder-quobyte-d49b66e0-9d94-4503-859b-02b318c2d050" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Acquiring lock "cinder-quobyte-39eb2dfa-8d03-4397-883d-fa225be79099" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Lock "cinder-quobyte-39eb2dfa-8d03-4397-883d-fa225be79099" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Deleting offline snapshot 39eb2dfa-8d03-4397-883d-fa225be79099 of volume d49b66e0-9d94-4503-859b-02b318c2d050 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:03:57 devstack sudo[106149]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] snapshot_file for this snap is: volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.497s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:03:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Deleted volume successfully. Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[22d405e1-6f85-4556-b77e-e333a026aefd]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1a971d39-cbfd-40a3-80dc-a08cb5dbc09c tempest-VolumeAndVolumeTypeFromImageTest-94922194 None] Lock "cinder-1581d513-b7f5-4a47-9702-17c17c026ef8-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:57 devstack sudo[106158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099 Sep 07 14:03:57 devstack sudo[106158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:58 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d 1073741824" returned: 0 in 0.712s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:58 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d Sep 07 14:03:58 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:58 devstack sudo[106158]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099" returned: 0 in 0.508s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d49b66e0-9d94-4503-859b-02b318c2d050(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cb8ff4-3870-4d9c-bee4-33a26f9c8e60]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:58 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d" returned: 0 in 0.346s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] <== create_volume: return (1109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.609s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1551982662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c376c69-9899-475d-92ba-91c7fc27ad4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef654f19145f40a098808b4d2adb9fb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:03:54Z,use_quota=True,user_id='ccd6bb8c393247cf8414ed551ebdcd12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Creating volume 0c376c69-9899-475d-92ba-91c7fc27ad4e {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:03:58 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c376c69-9899-475d-92ba-91c7fc27ad4e 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:58 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050 Sep 07 14:03:58 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (806fc272-2eca-41e4-84ae-df887e6fe305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:58 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c376c69-9899-475d-92ba-91c7fc27ad4e 1073741824 Sep 07 14:03:58 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c53028-1585-42b2-9486-41d85f1cbe36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:58 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume volume-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d (2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d): created successfully Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c53028-1585-42b2-9486-41d85f1cbe36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Flow 'volume_create_manager' (14894307-d141-4679-b26d-d036b901b7e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3e0eeb64-a8e8-4269-a3e3-4240a4f506ce tempest-CreateVolumesFromSnapshotTest-1459555228 None] Created volume successfully. Sep 07 14:03:58 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050" returned: 0 in 0.478s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:58 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099 Sep 07 14:03:58 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:59 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c376c69-9899-475d-92ba-91c7fc27ad4e 1073741824" returned: 0 in 0.652s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c376c69-9899-475d-92ba-91c7fc27ad4e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:59 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c376c69-9899-475d-92ba-91c7fc27ad4e Sep 07 14:03:59 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:59 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099" returned: 0 in 0.438s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:03:59 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099 Sep 07 14:03:59 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:03:59 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c376c69-9899-475d-92ba-91c7fc27ad4e" returned: 0 in 0.356s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:03:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:03:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97e5d3c9-5d78-406b-a148-2669446e617d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c376c69-9899-475d-92ba-91c7fc27ad4e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:59 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Sep 07 14:03:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa9ffeb-ba51-4db1-9d20-a09b1983317a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:03:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050.39eb2dfa-8d03-4397-883d-fa225be79099" returned: 0 in 0.332s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:03:59 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Volume volume-0c376c69-9899-475d-92ba-91c7fc27ad4e (0c376c69-9899-475d-92ba-91c7fc27ad4e): created successfully Sep 07 14:03:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fa9ffeb-ba51-4db1-9d20-a09b1983317a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:03:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Flow 'volume_create_manager' (969c9e07-55da-410d-a4ec-fadff882fe0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:03:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Lock "cinder-quobyte-39eb2dfa-8d03-4397-883d-fa225be79099" released by "_delete_snapshot" :: held 1.919s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:59 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-925a44cf-d0a8-4934-887e-faae94888ed1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Created volume successfully. Sep 07 14:03:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Lock "cinder-quobyte-d49b66e0-9d94-4503-859b-02b318c2d050" released by "delete_snapshot" :: held 1.955s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:03:59 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Created reservations ['8c4bf018-e3c7-42a2-8778-90a33a5124f1', '061e2398-477c-4177-896e-bfcdbb1ab69a', '8cb21379-f0d6-4d8a-8d87-a12e08ea07b7', 'f52cebc4-2780-43d5-bfb1-73d87431baed'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:03:59 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Delete snapshot completed successfully. Sep 07 14:03:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-20b6e027-126b-4784-a9ba-05c05aca0d29 tempest-CinderUnicodeTest-1425208597 None] Lock "cinder-39eb2dfa-8d03-4397-883d-fa225be79099-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "cinder-0c376c69-9899-475d-92ba-91c7fc27ad4e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-0c376c69-9899-475d-92ba-91c7fc27ad4e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "cinder-quobyte-0c376c69-9899-475d-92ba-91c7fc27ad4e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-quobyte-0c376c69-9899-475d-92ba-91c7fc27ad4e" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14e908b-eca5-4346-83cc-fd35956df833]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c376c69-9899-475d-92ba-91c7fc27ad4e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:00 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c376c69-9899-475d-92ba-91c7fc27ad4e Sep 07 14:04:00 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:00 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c376c69-9899-475d-92ba-91c7fc27ad4e" returned: 0 in 0.444s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c376c69-9899-475d-92ba-91c7fc27ad4e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Acquiring lock "cinder-d49b66e0-9d94-4503-859b-02b318c2d050-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:00 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c376c69-9899-475d-92ba-91c7fc27ad4e Sep 07 14:04:00 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Lock "cinder-d49b66e0-9d94-4503-859b-02b318c2d050-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Acquiring lock "cinder-quobyte-d49b66e0-9d94-4503-859b-02b318c2d050" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Lock "cinder-quobyte-d49b66e0-9d94-4503-859b-02b318c2d050" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8246ebe-7573-4c95-bdb9-6a9bb8d83ef9]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:01 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050 Sep 07 14:04:01 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:01 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0c376c69-9899-475d-92ba-91c7fc27ad4e" returned: 0 in 0.407s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-quobyte-0c376c69-9899-475d-92ba-91c7fc27ad4e" released by "delete_volume" :: held 0.914s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Created reservations ['86a8f467-456b-4cf7-b425-63480434104c', '73e655c6-92fe-4c6a-a378-322d3dcd611b', '1a7d56a9-3918-450f-91a7-60f03888629c', '6bc46202-863c-48f2-b759-40b357d3186a'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:01 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:01 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:01 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050" returned: 0 in 0.520s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:01 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050 Sep 07 14:04:01 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:01 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.352s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Deleted volume successfully. Sep 07 14:04:01 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d49b66e0-9d94-4503-859b-02b318c2d050" returned: 0 in 0.290s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Lock "cinder-quobyte-d49b66e0-9d94-4503-859b-02b318c2d050" released by "delete_volume" :: held 0.907s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a66ee161-915c-4b8f-8820-f8a023b48d72 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-0c376c69-9899-475d-92ba-91c7fc27ad4e-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:01 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Created reservations ['d4786edf-e7f8-45ec-827f-5a31e9c7d32c', '1fe17aaa-d21c-4295-b2f8-723bce308fa9', '98e78492-9d22-45b3-bb84-b9fd9912493e', 'ffb21602-5c14-4c43-a63a-e308c562c188'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:02 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:02 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Flow 'volume_create_manager' (698d7dd9-9aeb-4e42-9a3b-34e250ec5f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e0304a-5a31-4894-bb1d-566dfd681aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e0304a-5a31-4894-bb1d-566dfd681aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c431e204-0587-4ac4-b467-2bf453a79062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58861455164426595ab7044177edb45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:02Z,use_quota=True,user_id='959f4f48058d458d90a15c27dbeb5ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20924b2e-cf94-4e9c-a2fd-ddfa196d30ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20924b2e-cf94-4e9c-a2fd-ddfa196d30ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb57154-a642-4820-a8f6-4640dcdaef87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 07 14:04:02 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.277s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:02 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Deleted volume successfully. Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1662e27b-679e-4dff-988d-273174199ebb tempest-CinderUnicodeTest-1425208597 None] Lock "cinder-d49b66e0-9d94-4503-859b-02b318c2d050-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "cinder-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "cinder-quobyte-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-quobyte-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ebb192-414f-4e24-a262-88da73e34de0]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:02 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d Sep 07 14:04:02 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcb57154-a642-4820-a8f6-4640dcdaef87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c431e204-0587-4ac4-b467-2bf453a79062', 'volume_name': 'volume-c431e204-0587-4ac4-b467-2bf453a79062', 'volume_size': 1, 'image_id': '9d310f22-82b7-4e38-9e35-223b314e6096', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d310f22-82b7-4e38-9e35-223b314e6096', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a8c308c41188201fcd11f13d68e75a21', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c58861455164426595ab7044177edb45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '300d14f7a49ff6c5d146aadbcb8a60cf0a66d28620f39a522e8bd42d347e068e820af77d05776da0d2afa2f3e5d52dd75666445ecd4d5728d6a9934387848724', 'id': '9d310f22-82b7-4e38-9e35-223b314e6096', 'created_at': datetime.datetime(2026, 9, 7, 12, 3, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 4, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d310f22-82b7-4e38-9e35-223b314e6096/file', 'properties': {}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d93e80-7da1-4442-b9f7-56baa213abc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67d93e80-7da1-4442-b9f7-56baa213abc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99467732-99ab-4487-b188-b6d13591ed51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:02 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Volume c431e204-0587-4ac4-b467-2bf453a79062: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c431e204-0587-4ac4-b467-2bf453a79062', 'volume_size': 1, 'image_id': '9d310f22-82b7-4e38-9e35-223b314e6096', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d310f22-82b7-4e38-9e35-223b314e6096', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a8c308c41188201fcd11f13d68e75a21', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c58861455164426595ab7044177edb45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '300d14f7a49ff6c5d146aadbcb8a60cf0a66d28620f39a522e8bd42d347e068e820af77d05776da0d2afa2f3e5d52dd75666445ecd4d5728d6a9934387848724', 'id': '9d310f22-82b7-4e38-9e35-223b314e6096', 'created_at': datetime.datetime(2026, 9, 7, 12, 3, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 4, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d310f22-82b7-4e38-9e35-223b314e6096/file', 'properties': {}}, 'image_service': } Sep 07 14:04:02 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Trying to clone c431e204-0587-4ac4-b467-2bf453a79062 from image 9d310f22-82b7-4e38-9e35-223b314e6096 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9d310f22-82b7-4e38-9e35-223b314e6096', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 07 14:04:03 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Image download 0.00 MB at 0.00 MB/s Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[490fcd55-f0bb-4653-922d-8a02ebbb951a]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:03 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d" returned: 0 in 0.492s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:03 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d Sep 07 14:04:03 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:03 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD Sep 07 14:04:03 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Acquiring lock "cinder-51a20a51-785d-40ac-978c-cf16778ef72b-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Lock "cinder-51a20a51-785d-40ac-978c-cf16778ef72b-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Flow 'volume_create_manager' (336e536c-becd-4ba2-a08d-2290a8750228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eff7e1c-a3f7-4736-9e74-aa304484c92b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eff7e1c-a3f7-4736-9e74-aa304484c92b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-109287167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7464683-8acd-4f7e-a81c-9bb26f0a030a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5317ed2dadf14f0191bc6996f9793089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:03Z,use_quota=True,user_id='84002b2f9e9d460e8561bb9f41451570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e9d982-c2df-4858-9759-2ef259c82838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9e9d982-c2df-4858-9759-2ef259c82838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0573491-c346-4591-8c54-2fec90bbabb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0573491-c346-4591-8c54-2fec90bbabb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7464683-8acd-4f7e-a81c-9bb26f0a030a', 'volume_name': 'volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b968475-b013-4dca-9099-ae792ffdb8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b968475-b013-4dca-9099-ae792ffdb8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6893fa43-4ca5-4d8e-9ecf-abcc63707d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:03 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Volume a7464683-8acd-4f7e-a81c-9bb26f0a030a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a', 'volume_size': 1} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-109287167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7464683-8acd-4f7e-a81c-9bb26f0a030a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5317ed2dadf14f0191bc6996f9793089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:03Z,use_quota=True,user_id='84002b2f9e9d460e8561bb9f41451570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Creating volume a7464683-8acd-4f7e-a81c-9bb26f0a030a {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:03 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:03 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD" returned: 0 in 0.412s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:03 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a 1073741824 Sep 07 14:04:03 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Acquiring lock "cinder-quobyte-51a20a51-785d-40ac-978c-cf16778ef72b" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Lock "cinder-quobyte-51a20a51-785d-40ac-978c-cf16778ef72b" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:03 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d" returned: 0 in 0.419s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-quobyte-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d" released by "delete_volume" :: held 0.957s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc733bb-9c1e-462c-a5f9-bd78ce9c659a]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51a20a51-785d-40ac-978c-cf16778ef72b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Created reservations ['fab92e44-f090-4983-b1cf-68dd8b754ce7', 'd48b2f62-88dc-4cfb-9f00-ba425f4080fd', '2983c7f5-ee77-42a9-b342-b9875d6f19c6', 'dc427cf8-605a-4a95-a138-d5c6b287d458'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:03 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD Sep 07 14:04:03 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:03 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51a20a51-785d-40ac-978c-cf16778ef72b Sep 07 14:04:03 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:03 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:03 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:03 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a 1073741824" returned: 0 in 0.493s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:04 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD" returned: 1 in 0.486s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Temporary image 9d310f22-82b7-4e38-9e35-223b314e6096 is fetched for user 959f4f48058d458d90a15c27dbeb5ff3. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:04 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:04 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.290s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51a20a51-785d-40ac-978c-cf16778ef72b" returned: 0 in 0.468s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:04 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a Sep 07 14:04:04 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51a20a51-785d-40ac-978c-cf16778ef72b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:04 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51a20a51-785d-40ac-978c-cf16778ef72b Sep 07 14:04:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Deleted volume successfully. Sep 07 14:04:04 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8434bba8-5933-4f4c-b1c3-d6d9fc93e8fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-2a68cfd3-42bb-4cc0-a8fe-86d4d6c9d98d-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[48199241-3ad7-41ef-819c-8d3e8802932a]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:04 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD Sep 07 14:04:04 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:04 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a" returned: 0 in 0.321s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6893fa43-4ca5-4d8e-9ecf-abcc63707d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed931fc0-4993-4cc2-a294-b70ea24ca2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:04 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:04 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Volume volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a (a7464683-8acd-4f7e-a81c-9bb26f0a030a): created successfully Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed931fc0-4993-4cc2-a294-b70ea24ca2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Flow 'volume_create_manager' (336e536c-becd-4ba2-a08d-2290a8750228) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-51a20a51-785d-40ac-978c-cf16778ef72b" returned: 0 in 0.371s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Lock "cinder-quobyte-51a20a51-785d-40ac-978c-cf16778ef72b" released by "delete_volume" :: held 0.901s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8e7f402a-b21e-48aa-bd7b-4d20bf671cd0 tempest-VolumeDependencyTests-1258754705 None] Created volume successfully. Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Created reservations ['10d8a2a5-1636-4667-b872-cf3f4938b526', '19c3ef91-fbfc-4df3-870a-39852205e1cf', 'a6643c4c-68f2-4352-82f3-7e94814a489a', '1b30e137-f938-4a9c-b9d8-d456d11ad37f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:04 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD" returned: 0 in 0.426s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:04 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:04 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:04 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD Sep 07 14:04:04 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "cinder-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "cinder-quobyte-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-quobyte-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:04 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.298s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Deleted volume successfully. Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[269487de-bbf0-4b47-8516-f2ca0f921725]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:04 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c431e204-0587-4ac4-b467-2bf453a79062,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c58861455164426595ab7044177edb45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:02Z,use_quota=True,user_id='959f4f48058d458d90a15c27dbeb5ff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Creating volume c431e204-0587-4ac4-b467-2bf453a79062 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:04 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52741cf4-4efc-4516-8f8e-fdcd539d6ad4 tempest-CinderUnicodeTest-1425208597 None] Lock "cinder-51a20a51-785d-40ac-978c-cf16778ef72b-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:04 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062 1073741824 Sep 07 14:04:04 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:05 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b Sep 07 14:04:05 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:05 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b" returned: 0 in 0.400s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:05 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b Sep 07 14:04:05 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:05 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062 1073741824" returned: 0 in 0.600s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:05 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062 Sep 07 14:04:05 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:05 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b" returned: 0 in 0.302s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-quobyte-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b" released by "delete_volume" :: held 0.758s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Created reservations ['1f306200-014b-47e9-acd7-607504818a26', '9f6010aa-d94c-4c0a-b4c6-ecf7cb58361b', 'fda17db2-4e0c-4594-ac23-a18b15080cbe', 'ab032a2a-9d28-4882-bfb1-98ab8003931e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:05 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:05 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:05 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062" returned: 0 in 0.286s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.345s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] Creating offline snapshot 497fad01-3584-45eb-a75b-80b0ff17fef8 of volume a7464683-8acd-4f7e-a81c-9bb26f0a030a {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Attempting download of 9d310f22-82b7-4e38-9e35-223b314e6096 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d310f22-82b7-4e38-9e35-223b314e6096', 'metadata': {}}])) to volume c431e204-0587-4ac4-b467-2bf453a79062. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ffd46c6-d15c-4429-bf8f-e93bae9b162b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[83440570-bea5-453f-ba14-e0d6bcd0a5c3]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d310f22-82b7-4e38-9e35-223b314e6096_zfprgbp9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "cinder-1eea5cd5-cb42-447d-8f3f-458be9174b29-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:06 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a Sep 07 14:04:06 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-1eea5cd5-cb42-447d-8f3f-458be9174b29-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:06 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.363s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "cinder-quobyte-1eea5cd5-cb42-447d-8f3f-458be9174b29" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Deleted volume successfully. Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-quobyte-1eea5cd5-cb42-447d-8f3f-458be9174b29" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0da18eba-56e4-4a2b-b1dd-f39c7571a2fd tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-8ac08ca5-22c1-4e7a-bfd1-9a234eec713b-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc74d5a-56b4-4eb7-b8a8-fb54501b30a2]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1eea5cd5-cb42-447d-8f3f-458be9174b29 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:06 devstack sudo[106289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d310f22-82b7-4e38-9e35-223b314e6096_zfprgbp9 Sep 07 14:04:06 devstack sudo[106289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:06 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1eea5cd5-cb42-447d-8f3f-458be9174b29 Sep 07 14:04:06 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:06 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a" returned: 0 in 0.514s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:06 devstack sudo[106298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 1G Sep 07 14:04:06 devstack sudo[106298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:06 devstack sudo[106289]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9d310f22-82b7-4e38-9e35-223b314e6096_zfprgbp9" returned: 0 in 0.510s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d310f22-82b7-4e38-9e35-223b314e6096_zfprgbp9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:06 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d310f22-82b7-4e38-9e35-223b314e6096_zfprgbp9 Sep 07 14:04:06 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:06 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1eea5cd5-cb42-447d-8f3f-458be9174b29" returned: 0 in 0.533s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1eea5cd5-cb42-447d-8f3f-458be9174b29 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:06 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1eea5cd5-cb42-447d-8f3f-458be9174b29 Sep 07 14:04:06 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:06 devstack sudo[106298]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 1G" returned: 0 in 0.518s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:07 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d310f22-82b7-4e38-9e35-223b314e6096_zfprgbp9" returned: 1 in 0.452s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9d310f22-82b7-4e38-9e35-223b314e6096_zfprgbp9' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[18771618-ed4f-4a78-af69-8512ecc96287]: (4, 'raw') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:07 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 Sep 07 14:04:07 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:07 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1eea5cd5-cb42-447d-8f3f-458be9174b29" returned: 0 in 0.337s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:07 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-quobyte-1eea5cd5-cb42-447d-8f3f-458be9174b29" released by "delete_volume" :: held 0.952s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:07 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Created reservations ['01028602-7fb6-411b-a13d-3c86286b7a29', '524d8367-a535-467a-a7e9-fa7d8f3b0062', 'bc39bd84-19c3-441b-b505-e0085f6b3e90', '6ea47140-c77c-4ae8-8ef2-320b6e375c3d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:07 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8" returned: 0 in 0.404s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:07 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 is being set with open permissions: ugo+rw Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:07 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:07 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:07 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 Sep 07 14:04:07 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:07 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD" returned: 0 in 0.498s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:07 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD Sep 07 14:04:07 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:07 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8" returned: 0 in 0.316s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:07 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.368s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Deleted volume successfully. Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-34d282a5-6c83-4dfd-855b-5c9bedb12ca1 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-1eea5cd5-cb42-447d-8f3f-458be9174b29-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:07 devstack sudo[106333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.info Sep 07 14:04:07 devstack sudo[106333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:07 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD" returned: 1 in 0.413s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] 9d310f22-82b7-4e38-9e35-223b314e6096 was raw, converting to qcow2 {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 07 14:04:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:07 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062 Sep 07 14:04:07 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:08 devstack sudo[106333]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.info" returned: 0 in 0.297s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:08 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.info is being set with open permissions: ugo+rw Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:08 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.info Sep 07 14:04:08 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "cinder-009a02c9-8423-4258-9e0e-79c025cd11ed-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:08 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.info" returned: 0 in 0.317s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.521s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-009a02c9-8423-4258-9e0e-79c025cd11ed-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-422e833f-58d6-4236-aec3-47f303e9a72f tempest-VolumeDependencyTests-1258754705 None] Create snapshot completed successfully Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "cinder-quobyte-009a02c9-8423-4258-9e0e-79c025cd11ed" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-quobyte-009a02c9-8423-4258-9e0e-79c025cd11ed" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:08 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062" returned: 0 in 0.580s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9d310f22-82b7-4e38-9e35-223b314e6096_pt9_xkijdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 14:04:08 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Converted 0.00 MB image at 0.00 MB/s Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e1f0a2-34b5-4a18-a79a-5bd4d3e0584e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-009a02c9-8423-4258-9e0e-79c025cd11ed {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:08 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062 1G Sep 07 14:04:08 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:08 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-009a02c9-8423-4258-9e0e-79c025cd11ed Sep 07 14:04:08 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:08 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062 1G" returned: 0 in 0.320s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Downloaded image 9d310f22-82b7-4e38-9e35-223b314e6096 ((None, [{'url': 'file:///opt/stack/data/glance/images/9d310f22-82b7-4e38-9e35-223b314e6096', 'metadata': {}}])) to volume c431e204-0587-4ac4-b467-2bf453a79062 successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Temporary image 9d310f22-82b7-4e38-9e35-223b314e6096 for user 959f4f48058d458d90a15c27dbeb5ff3 is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Marking volume c431e204-0587-4ac4-b467-2bf453a79062 as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Copying metadata from image 9d310f22-82b7-4e38-9e35-223b314e6096 to c431e204-0587-4ac4-b467-2bf453a79062. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Creating volume glance metadata for volume c431e204-0587-4ac4-b467-2bf453a79062 backed by image 9d310f22-82b7-4e38-9e35-223b314e6096 with: {'image_id': '9d310f22-82b7-4e38-9e35-223b314e6096', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a8c308c41188201fcd11f13d68e75a21', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99467732-99ab-4487-b188-b6d13591ed51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c431e204-0587-4ac4-b467-2bf453a79062', 'volume_size': 1, 'image_id': '9d310f22-82b7-4e38-9e35-223b314e6096', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9d310f22-82b7-4e38-9e35-223b314e6096', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a8c308c41188201fcd11f13d68e75a21', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c58861455164426595ab7044177edb45', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '300d14f7a49ff6c5d146aadbcb8a60cf0a66d28620f39a522e8bd42d347e068e820af77d05776da0d2afa2f3e5d52dd75666445ecd4d5728d6a9934387848724', 'id': '9d310f22-82b7-4e38-9e35-223b314e6096', 'created_at': datetime.datetime(2026, 9, 7, 12, 3, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 7, 12, 4, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9d310f22-82b7-4e38-9e35-223b314e6096/file', 'properties': {}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc6ad44-5dfa-4ea4-a790-6684b6bb119f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:08 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Volume volume-c431e204-0587-4ac4-b467-2bf453a79062 (c431e204-0587-4ac4-b467-2bf453a79062): created successfully Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cc6ad44-5dfa-4ea4-a790-6684b6bb119f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Flow 'volume_create_manager' (698d7dd9-9aeb-4e42-9a3b-34e250ec5f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:09 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-009a02c9-8423-4258-9e0e-79c025cd11ed" returned: 0 in 0.466s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-009a02c9-8423-4258-9e0e-79c025cd11ed {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-67ac6d24-ad99-4a20-a5a9-1b6c6f266a49 tempest-VolumeImageDependencyTests-2122133340 None] Created volume successfully. Sep 07 14:04:09 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-009a02c9-8423-4258-9e0e-79c025cd11ed Sep 07 14:04:09 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:09 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-009a02c9-8423-4258-9e0e-79c025cd11ed" returned: 0 in 0.304s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-quobyte-009a02c9-8423-4258-9e0e-79c025cd11ed" released by "delete_volume" :: held 0.832s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Created reservations ['a48d5045-e673-4ea8-8054-db72bc042511', '88a39248-97c7-4bca-860c-5b4e62d5a069', 'b939d177-783f-4ce7-9f5b-2ef5e1979d70', '5676b209-0d4e-4368-a14b-371432b37b61'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Flow 'volume_create_manager' (28f4077f-8cda-4a21-94bf-92528e3127eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d389fc03-e77e-474b-a35e-14a11bf24689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "cinder-67f62ffd-12f1-4669-ac5d-9552fec21453-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d389fc03-e77e-474b-a35e-14a11bf24689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-942878355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0b27957-3616-44bc-aa90-69869eeb9719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5317ed2dadf14f0191bc6996f9793089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=497fad01-3584-45eb-a75b-80b0ff17fef8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:09Z,use_quota=True,user_id='84002b2f9e9d460e8561bb9f41451570',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb662a2-a894-4f25-b17c-010eaf3cf0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdb662a2-a894-4f25-b17c-010eaf3cf0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132133b6-1085-48b9-8768-7db775ace106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (132133b6-1085-48b9-8768-7db775ace106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'c0b27957-3616-44bc-aa90-69869eeb9719', 'volume_name': 'volume-c0b27957-3616-44bc-aa90-69869eeb9719', 'volume_size': 1, 'snapshot_id': '497fad01-3584-45eb-a75b-80b0ff17fef8'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:09 devstack sudo[106362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42ec6cd-2138-495a-93e0-273d975f9794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a42ec6cd-2138-495a-93e0-273d975f9794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6922b02-ff1a-4129-98c5-357666488b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:09 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Volume c0b27957-3616-44bc-aa90-69869eeb9719: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-c0b27957-3616-44bc-aa90-69869eeb9719', 'volume_size': 1, 'snapshot_id': '497fad01-3584-45eb-a75b-80b0ff17fef8'} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "cinder-quobyte-497fad01-3584-45eb-a75b-80b0ff17fef8-c0b27957-3616-44bc-aa90-69869eeb9719" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-67f62ffd-12f1-4669-ac5d-9552fec21453-delete_snapshot" acquired by "delete_snapshot" :: waited 0.082s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "cinder-quobyte-e60d0fc5-e685-42c3-ad47-acda4fdf7019" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-quobyte-e60d0fc5-e685-42c3-ad47-acda4fdf7019" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "cinder-quobyte-67f62ffd-12f1-4669-ac5d-9552fec21453" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-quobyte-497fad01-3584-45eb-a75b-80b0ff17fef8-c0b27957-3616-44bc-aa90-69869eeb9719" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Creating volume c0b27957-3616-44bc-aa90-69869eeb9719 from snapshot 497fad01-3584-45eb-a75b-80b0ff17fef8 {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 14:04:09 devstack sudo[106362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "cinder-quobyte-c0b27957-3616-44bc-aa90-69869eeb9719" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-quobyte-c0b27957-3616-44bc-aa90-69869eeb9719" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] snapshot: 497fad01-3584-45eb-a75b-80b0ff17fef8, volume: c0b27957-3616-44bc-aa90-69869eeb9719, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-quobyte-67f62ffd-12f1-4669-ac5d-9552fec21453" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Deleting offline snapshot 67f62ffd-12f1-4669-ac5d-9552fec21453 of volume e60d0fc5-e685-42c3-ad47-acda4fdf7019 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] snapshot_file for this snap is: volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c67baefa-e8eb-4c61-b251-2276b1d50e47]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaf6e28-a603-449a-b2b7-3455dbc65d68]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:09 devstack sudo[106362]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Acquiring lock "cinder-c431e204-0587-4ac4-b467-2bf453a79062-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.444s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:10 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453 Sep 07 14:04:10 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Deleted volume successfully. Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Lock "cinder-c431e204-0587-4ac4-b467-2bf453a79062-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-03efe60a-eb19-41d3-9e69-35a02abb2740 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-009a02c9-8423-4258-9e0e-79c025cd11ed-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Acquiring lock "cinder-quobyte-c431e204-0587-4ac4-b467-2bf453a79062" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Lock "cinder-quobyte-c431e204-0587-4ac4-b467-2bf453a79062" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:10 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 Sep 07 14:04:10 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2bdb759-7307-4336-b12a-a72d1aa2c19c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:10 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062 Sep 07 14:04:10 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:10 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453" returned: 0 in 0.607s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a25dae16-30f6-4d9f-baa6-7279f451b3c3]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:10 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8" returned: 0 in 0.610s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[781a696c-2f78-4e3f-ae17-3e856ea632a9]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:10 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 Sep 07 14:04:10 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:10 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a Sep 07 14:04:10 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:10 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062" returned: 0 in 0.601s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:10 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062 Sep 07 14:04:10 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:10 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019" returned: 0 in 0.451s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:11 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453 Sep 07 14:04:11 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:11 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a" returned: 0 in 0.510s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] will copy from snapshot at /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Path /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c0b27957-3616-44bc-aa90-69869eeb9719 not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c0b27957-3616-44bc-aa90-69869eeb9719 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:11 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c0b27957-3616-44bc-aa90-69869eeb9719 Sep 07 14:04:11 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:11 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c431e204-0587-4ac4-b467-2bf453a79062" returned: 0 in 0.358s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Lock "cinder-quobyte-c431e204-0587-4ac4-b467-2bf453a79062" released by "delete_volume" :: held 1.040s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Created reservations ['aefb9e71-8227-40f8-afb1-588f0c915d84', 'c0ac2157-2aef-4fe0-a744-518f477b089e', '9229a61b-9610-4497-b6c7-f8488fe5b5d5', '610274bc-62d3-44f0-95db-a44eaba91a7b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:11 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:11 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:11 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453" returned: 0 in 0.419s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:11 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453 Sep 07 14:04:11 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:11 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.281s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:11 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Deleted volume successfully. Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-69cde8d0-4e26-426f-a454-0be15a356abd tempest-VolumeImageDependencyTests-2122133340 None] Lock "cinder-c431e204-0587-4ac4-b467-2bf453a79062-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:11 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019.67f62ffd-12f1-4669-ac5d-9552fec21453" returned: 0 in 0.355s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-quobyte-67f62ffd-12f1-4669-ac5d-9552fec21453" released by "_delete_snapshot" :: held 2.068s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-quobyte-e60d0fc5-e685-42c3-ad47-acda4fdf7019" released by "delete_snapshot" :: held 2.147s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:12 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Created reservations ['fb2ebdf6-698f-4896-803a-e86ff40009e6', '6c0ed16b-0f75-443c-b967-f7fd64d1fdb3', '83c37346-e5a0-45a9-a993-3c1c1f0e697f', '8c9c05d1-76d0-4ba8-9cb5-78d2884f59ff'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Delete snapshot completed successfully. Sep 07 14:04:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9b8a8d77-bd64-41bb-912a-0eb556f4f9a9 tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-67f62ffd-12f1-4669-ac5d-9552fec21453-delete_snapshot" released by "delete_snapshot" :: held 2.600s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "cinder-e60d0fc5-e685-42c3-ad47-acda4fdf7019-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-e60d0fc5-e685-42c3-ad47-acda4fdf7019-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "cinder-quobyte-e60d0fc5-e685-42c3-ad47-acda4fdf7019" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-quobyte-e60d0fc5-e685-42c3-ad47-acda4fdf7019" acquired by "delete_volume" :: waited 0.052s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:13 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[08cd8e67-ea70-4b40-8b86-773df259fde6]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:13 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 Sep 07 14:04:13 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:14 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019" returned: 0 in 0.960s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:14 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019 Sep 07 14:04:14 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:14 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e60d0fc5-e685-42c3-ad47-acda4fdf7019" returned: 0 in 0.493s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-quobyte-e60d0fc5-e685-42c3-ad47-acda4fdf7019" released by "delete_volume" :: held 1.658s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:15 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Created reservations ['2cee2413-6602-4aa6-b274-f0196c01f60d', '3458a9ef-4ed6-4cdc-93ea-87b1fbe9e121', '4b5bc72b-decf-4b33-8392-c68a103be932', '00db51ba-6241-4847-8409-2cb5246d7a52'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:15 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:15 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:15 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.399s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:15 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:15 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Deleted volume successfully. Sep 07 14:04:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d712cd1a-a39e-4f0f-94e2-49cf4e8f486c tempest-CreateVolumesFromSnapshotTest-1459555228 None] Lock "cinder-e60d0fc5-e685-42c3-ad47-acda4fdf7019-delete_volume" released by "delete_volume" :: held 2.953s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:17 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c0b27957-3616-44bc-aa90-69869eeb9719" returned: 0 in 6.141s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:17 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Image conversion details: src /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a, size 1024.00 MB, duration 6.14 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c0b27957-3616-44bc-aa90-69869eeb9719 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 14:04:17 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Converted 1024.00 MB image at 166.73 MB/s Sep 07 14:04:17 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c0b27957-3616-44bc-aa90-69869eeb9719 is being set with open permissions: ugo+rw Sep 07 14:04:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c0b27957-3616-44bc-aa90-69869eeb9719 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:17 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c0b27957-3616-44bc-aa90-69869eeb9719 Sep 07 14:04:17 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:17 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c0b27957-3616-44bc-aa90-69869eeb9719" returned: 0 in 0.301s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-quobyte-c0b27957-3616-44bc-aa90-69869eeb9719" released by "_copy_volume_from_snapshot" :: held 7.781s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-quobyte-497fad01-3584-45eb-a75b-80b0ff17fef8-c0b27957-3616-44bc-aa90-69869eeb9719" released by "_create_volume_from_snapshot" :: held 7.875s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.905s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6922b02-ff1a-4129-98c5-357666488b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0b27957-3616-44bc-aa90-69869eeb9719', 'volume_size': 1, 'snapshot_id': '497fad01-3584-45eb-a75b-80b0ff17fef8'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ecef33-1500-4297-b9a4-a78c407627f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:17 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Volume volume-c0b27957-3616-44bc-aa90-69869eeb9719 (c0b27957-3616-44bc-aa90-69869eeb9719): created successfully Sep 07 14:04:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37ecef33-1500-4297-b9a4-a78c407627f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Flow 'volume_create_manager' (28f4077f-8cda-4a21-94bf-92528e3127eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:17 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7cdbf956-4a26-41f8-bd8a-4af9a256f97f tempest-VolumeDependencyTests-1258754705 None] Created volume successfully. Sep 07 14:04:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "cinder-497fad01-3584-45eb-a75b-80b0ff17fef8-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-497fad01-3584-45eb-a75b-80b0ff17fef8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "cinder-quobyte-a7464683-8acd-4f7e-a81c-9bb26f0a030a" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-quobyte-a7464683-8acd-4f7e-a81c-9bb26f0a030a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "cinder-quobyte-497fad01-3584-45eb-a75b-80b0ff17fef8" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-quobyte-497fad01-3584-45eb-a75b-80b0ff17fef8" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Deleting offline snapshot 497fad01-3584-45eb-a75b-80b0ff17fef8 of volume a7464683-8acd-4f7e-a81c-9bb26f0a030a {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:04:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] snapshot_file for this snap is: volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:04:18 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b1c63c-44dc-4f87-9adc-326b5288bca5]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:18 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 Sep 07 14:04:18 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:19 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8" returned: 0 in 0.484s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:04:19 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea352821-e651-45fc-8874-327c2bee2b5f]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:19 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a Sep 07 14:04:19 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:19 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a" returned: 0 in 0.747s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:20 devstack sudo[106445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 Sep 07 14:04:20 devstack sudo[106445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:20 devstack sudo[106445]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8" returned: 0 in 0.597s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:20 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8 Sep 07 14:04:20 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:20 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a.497fad01-3584-45eb-a75b-80b0ff17fef8" returned: 0 in 0.310s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-quobyte-497fad01-3584-45eb-a75b-80b0ff17fef8" released by "_delete_snapshot" :: held 2.306s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-quobyte-a7464683-8acd-4f7e-a81c-9bb26f0a030a" released by "delete_snapshot" :: held 2.346s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Created reservations ['822ed127-3bb4-47e0-8ac6-40abea14381e', 'bb2ff71a-4686-49f3-a662-1d1c5af2d832', '62ee1da7-6b2c-49b0-bd62-603929844906', '405f9c26-62fe-4769-8e94-2ac396fa1786'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Delete snapshot completed successfully. Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Flow 'volume_create_manager' (d8f7609d-8498-41f6-9847-9c19bd07a9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d1aad4-85c4-4a96-a8bb-bf79d1abe316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-140a064d-f391-47da-bced-3b73d90678ee tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-497fad01-3584-45eb-a75b-80b0ff17fef8-delete_snapshot" released by "delete_snapshot" :: held 2.587s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13d1aad4-85c4-4a96-a8bb-bf79d1abe316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1410500317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c60796a-30a2-4d70-ba52-0b8cf5fdd48f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8594f0675c81499c891ff47bc5b88fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:21Z,use_quota=True,user_id='86ecaaa56942489fb7981558a2ebe579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3060e0-bc72-4e3e-bdd7-e1a1853b2a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df3060e0-bc72-4e3e-bdd7-e1a1853b2a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da08f7d9-6df2-4507-8fe2-3fc04042b5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da08f7d9-6df2-4507-8fe2-3fc04042b5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c60796a-30a2-4d70-ba52-0b8cf5fdd48f', 'volume_name': 'volume-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3022a0cd-b499-495b-8582-5e9d1c92c8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3022a0cd-b499-495b-8582-5e9d1c92c8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a021702-3680-4fe3-ba49-b60dc30f1b0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:21 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume 2c60796a-30a2-4d70-ba52-0b8cf5fdd48f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f', 'volume_size': 1} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1410500317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c60796a-30a2-4d70-ba52-0b8cf5fdd48f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8594f0675c81499c891ff47bc5b88fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:21Z,use_quota=True,user_id='86ecaaa56942489fb7981558a2ebe579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Creating volume 2c60796a-30a2-4d70-ba52-0b8cf5fdd48f {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:21 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:21 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f 1073741824 Sep 07 14:04:21 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:21 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f 1073741824" returned: 0 in 0.563s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:21 devstack sudo[106460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f Sep 07 14:04:21 devstack sudo[106460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "cinder-a7464683-8acd-4f7e-a81c-9bb26f0a030a-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-a7464683-8acd-4f7e-a81c-9bb26f0a030a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "cinder-quobyte-a7464683-8acd-4f7e-a81c-9bb26f0a030a" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-quobyte-a7464683-8acd-4f7e-a81c-9bb26f0a030a" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[25aedd28-961b-4908-bf0d-d92851496a60]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:22 devstack sudo[106460]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f" returned: 0 in 0.407s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a021702-3680-4fe3-ba49-b60dc30f1b0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be78bbd5-911d-4ea3-8f06-5c7fabfddf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:22 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume volume-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f (2c60796a-30a2-4d70-ba52-0b8cf5fdd48f): created successfully Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be78bbd5-911d-4ea3-8f06-5c7fabfddf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:22 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a Sep 07 14:04:22 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Flow 'volume_create_manager' (d8f7609d-8498-41f6-9847-9c19bd07a9d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a91dc675-7802-44e5-ae7f-d54686ef5a62 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Created volume successfully. Sep 07 14:04:22 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a" returned: 0 in 0.424s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:22 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a Sep 07 14:04:22 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:22 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a7464683-8acd-4f7e-a81c-9bb26f0a030a" returned: 0 in 0.285s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-quobyte-a7464683-8acd-4f7e-a81c-9bb26f0a030a" released by "delete_volume" :: held 0.791s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:23 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Created reservations ['1cfd6778-9aa7-4dbf-85e4-28a64f24d9a2', 'c394f1e2-64c7-49d0-a291-6c0fc8f0ca5a', '241e47e8-dc84-42a4-b370-db12c605331e', '8ae80a9e-4f6e-48f0-a963-54a0e1143d0b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:23 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:23 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "cinder-c0b27957-3616-44bc-aa90-69869eeb9719-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-c0b27957-3616-44bc-aa90-69869eeb9719-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "cinder-quobyte-c0b27957-3616-44bc-aa90-69869eeb9719" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-quobyte-c0b27957-3616-44bc-aa90-69869eeb9719" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[de25597b-0251-465c-95eb-c9b83d23c579]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c0b27957-3616-44bc-aa90-69869eeb9719 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:23 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.507s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:23 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:23 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Deleted volume successfully. Sep 07 14:04:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5a736f7f-0475-4ad0-b81a-0a901a365113 tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-a7464683-8acd-4f7e-a81c-9bb26f0a030a-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:23 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c0b27957-3616-44bc-aa90-69869eeb9719 Sep 07 14:04:23 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Flow 'volume_create_manager' (7ce8dcfd-5d28-44a1-acbc-c5c41a3cef2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9411bc6-cee3-4839-8843-d0bb314eacc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9411bc6-cee3-4839-8843-d0bb314eacc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1398220740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08662495-16c0-4f1b-9257-445f55236bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8594f0675c81499c891ff47bc5b88fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:24Z,use_quota=True,user_id='86ecaaa56942489fb7981558a2ebe579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4237444e-68b4-47ca-a61c-f457f3ac7958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4237444e-68b4-47ca-a61c-f457f3ac7958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afab23f-a8dd-43c9-8ab4-1a53f491204c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1afab23f-a8dd-43c9-8ab4-1a53f491204c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08662495-16c0-4f1b-9257-445f55236bcf', 'volume_name': 'volume-08662495-16c0-4f1b-9257-445f55236bcf', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb222071-e5ac-4dc0-9520-158651f0bd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb222071-e5ac-4dc0-9520-158651f0bd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:24 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2583dbc5-56f8-4e3c-947e-47c6e4149d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:24 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume 08662495-16c0-4f1b-9257-445f55236bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08662495-16c0-4f1b-9257-445f55236bcf', 'volume_size': 1} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1398220740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08662495-16c0-4f1b-9257-445f55236bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8594f0675c81499c891ff47bc5b88fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:24Z,use_quota=True,user_id='86ecaaa56942489fb7981558a2ebe579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Creating volume 08662495-16c0-4f1b-9257-445f55236bcf {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:24 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-08662495-16c0-4f1b-9257-445f55236bcf 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c0b27957-3616-44bc-aa90-69869eeb9719" returned: 0 in 0.691s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c0b27957-3616-44bc-aa90-69869eeb9719 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:24 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-08662495-16c0-4f1b-9257-445f55236bcf 1073741824 Sep 07 14:04:24 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:24 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c0b27957-3616-44bc-aa90-69869eeb9719 Sep 07 14:04:24 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Flow 'volume_create_manager' (594ff8a5-ced3-452e-b7cb-18c6f1c23a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1effb09-80b4-4930-8bbf-e21c79e57ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1effb09-80b4-4930-8bbf-e21c79e57ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-459694808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba5c0e7-1214-442a-a052-28945275667b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8594f0675c81499c891ff47bc5b88fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:25Z,use_quota=True,user_id='86ecaaa56942489fb7981558a2ebe579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ecd5922-ed0c-4357-97a5-5b4679526a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ecd5922-ed0c-4357-97a5-5b4679526a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34d555f-54da-469a-ba4f-86d8ab772d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:24 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c34d555f-54da-469a-ba4f-86d8ab772d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eba5c0e7-1214-442a-a052-28945275667b', 'volume_name': 'volume-eba5c0e7-1214-442a-a052-28945275667b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04385bb7-58fa-4f12-8e5d-b10b8f06768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04385bb7-58fa-4f12-8e5d-b10b8f06768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86403376-babd-4c84-b55d-5edf660be106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:24 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume eba5c0e7-1214-442a-a052-28945275667b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eba5c0e7-1214-442a-a052-28945275667b', 'volume_size': 1} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c0b27957-3616-44bc-aa90-69869eeb9719" returned: 0 in 0.490s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-quobyte-c0b27957-3616-44bc-aa90-69869eeb9719" released by "delete_volume" :: held 1.281s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:24 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Created reservations ['65eb7160-0e1a-43a7-a390-d9dffbaf0415', 'e4023701-63e8-4a31-92cb-fd1699ac75d7', '2bc19519-e635-43ae-a05a-918de6bef86c', '73272f72-0f23-4d61-b86e-5484596d7239'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:25 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:25 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:25 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-08662495-16c0-4f1b-9257-445f55236bcf 1073741824" returned: 0 in 0.865s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-08662495-16c0-4f1b-9257-445f55236bcf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:25 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-08662495-16c0-4f1b-9257-445f55236bcf Sep 07 14:04:25 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Flow 'volume_create_manager' (8bd3bd64-02e2-4157-bcdf-4016ec8885b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f0f149-b8e4-49eb-80c3-46b02fa71909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68f0f149-b8e4-49eb-80c3-46b02fa71909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1706131602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ba732a-770d-4976-ac7e-2b5082d93c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8594f0675c81499c891ff47bc5b88fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:25Z,use_quota=True,user_id='86ecaaa56942489fb7981558a2ebe579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f1a6c5-48d6-4ad3-b8f1-62bd5d45ba3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9f1a6c5-48d6-4ad3-b8f1-62bd5d45ba3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80e8ca0-cba8-4c45-8051-927249fbbb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a80e8ca0-cba8-4c45-8051-927249fbbb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2ba732a-770d-4976-ac7e-2b5082d93c75', 'volume_name': 'volume-a2ba732a-770d-4976-ac7e-2b5082d93c75', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb79161-3354-41ef-881a-5674ed008d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bb79161-3354-41ef-881a-5674ed008d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbc8c3f-5ef2-4a03-be8e-6a1a7f34e7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:25 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume a2ba732a-770d-4976-ac7e-2b5082d93c75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2ba732a-770d-4976-ac7e-2b5082d93c75', 'volume_size': 1} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:25 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.439s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Deleted volume successfully. Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0e748615-2974-41ce-ba03-4c446f39e73b tempest-VolumeDependencyTests-1258754705 None] Lock "cinder-c0b27957-3616-44bc-aa90-69869eeb9719-delete_volume" released by "delete_volume" :: held 2.073s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:25 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-08662495-16c0-4f1b-9257-445f55236bcf" returned: 0 in 0.589s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.095s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-459694808',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba5c0e7-1214-442a-a052-28945275667b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8594f0675c81499c891ff47bc5b88fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:25Z,use_quota=True,user_id='86ecaaa56942489fb7981558a2ebe579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Creating volume eba5c0e7-1214-442a-a052-28945275667b {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:25 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eba5c0e7-1214-442a-a052-28945275667b 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:25 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eba5c0e7-1214-442a-a052-28945275667b 1073741824 Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2583dbc5-56f8-4e3c-947e-47c6e4149d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08662495-16c0-4f1b-9257-445f55236bcf', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:25 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedaaf61-f673-4634-a93c-4ea74e6debd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:26 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume volume-08662495-16c0-4f1b-9257-445f55236bcf (08662495-16c0-4f1b-9257-445f55236bcf): created successfully Sep 07 14:04:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aedaaf61-f673-4634-a93c-4ea74e6debd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Flow 'volume_create_manager' (7ce8dcfd-5d28-44a1-acbc-c5c41a3cef2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:26 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Flow 'volume_create_manager' (94dcfa94-3ac6-4dd1-94c1-29b628d249b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaa493e-d558-4148-9df5-12b26f2a8290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afaa493e-d558-4148-9df5-12b26f2a8290) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-934808254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5048cf99-c7bc-4482-889a-2872abebdde3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8594f0675c81499c891ff47bc5b88fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:26Z,use_quota=True,user_id='86ecaaa56942489fb7981558a2ebe579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23e2f4a-6bfc-4d95-b27c-6fed2d50a20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f23e2f4a-6bfc-4d95-b27c-6fed2d50a20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5166b410-332e-42d0-ac89-f59942d7e595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5166b410-332e-42d0-ac89-f59942d7e595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5048cf99-c7bc-4482-889a-2872abebdde3', 'volume_name': 'volume-5048cf99-c7bc-4482-889a-2872abebdde3', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f606d4-fea3-43f8-bcb1-697a0316cd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f606d4-fea3-43f8-bcb1-697a0316cd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380a6552-eeea-4c01-a10e-c9dc8b3a063b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:26 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume 5048cf99-c7bc-4482-889a-2872abebdde3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5048cf99-c7bc-4482-889a-2872abebdde3', 'volume_size': 1} Sep 07 14:04:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7a5a3915-024c-4bce-bbf8-76b2bd06db6f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Created volume successfully. Sep 07 14:04:26 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eba5c0e7-1214-442a-a052-28945275667b 1073741824" returned: 0 in 1.061s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:26 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Flow 'volume_create_manager' (dd96f303-a8e6-4fea-a476-093655ccdc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943bd48c-8826-4bc5-923b-7ede84e8013f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (943bd48c-8826-4bc5-923b-7ede84e8013f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1424079434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe8db48e-376a-46a7-8d47-85ca49731676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8594f0675c81499c891ff47bc5b88fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:27Z,use_quota=True,user_id='86ecaaa56942489fb7981558a2ebe579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672f0021-b532-4f10-aa9c-83090c604a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672f0021-b532-4f10-aa9c-83090c604a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b2ca90-1a83-4a13-b86a-4d56ba11274d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7b2ca90-1a83-4a13-b86a-4d56ba11274d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe8db48e-376a-46a7-8d47-85ca49731676', 'volume_name': 'volume-fe8db48e-376a-46a7-8d47-85ca49731676', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0a785a-6686-4cd4-bbc8-637c6ea1b236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe0a785a-6686-4cd4-bbc8-637c6ea1b236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac48bec-d5b2-453c-87fe-c74fc77e183b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:27 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume fe8db48e-376a-46a7-8d47-85ca49731676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe8db48e-376a-46a7-8d47-85ca49731676', 'volume_size': 1} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eba5c0e7-1214-442a-a052-28945275667b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:27 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eba5c0e7-1214-442a-a052-28945275667b Sep 07 14:04:27 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:27 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eba5c0e7-1214-442a-a052-28945275667b" returned: 0 in 0.364s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.033s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1706131602',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2ba732a-770d-4976-ac7e-2b5082d93c75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8594f0675c81499c891ff47bc5b88fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:25Z,use_quota=True,user_id='86ecaaa56942489fb7981558a2ebe579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Creating volume a2ba732a-770d-4976-ac7e-2b5082d93c75 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:27 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a2ba732a-770d-4976-ac7e-2b5082d93c75 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:27 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a2ba732a-770d-4976-ac7e-2b5082d93c75 1073741824 Sep 07 14:04:27 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86403376-babd-4c84-b55d-5edf660be106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba5c0e7-1214-442a-a052-28945275667b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90540088-3435-4069-ae44-ea8634b1c2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:27 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume volume-eba5c0e7-1214-442a-a052-28945275667b (eba5c0e7-1214-442a-a052-28945275667b): created successfully Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90540088-3435-4069-ae44-ea8634b1c2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Flow 'volume_create_manager' (594ff8a5-ced3-452e-b7cb-18c6f1c23a0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:27 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8fc16b24-1f36-4fad-9eb9-7d8dc10d29e8 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Created volume successfully. Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Flow 'volume_create_manager' (95e01a47-75c3-4a16-af9c-df904037e526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ca7b57-4d58-4f64-8b8c-b16733a18227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:28 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01ca7b57-4d58-4f64-8b8c-b16733a18227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-820788246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc01204e-c16b-4abe-b06e-23c263cfbbfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd700d96db2447cbc813333f921bc7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:28Z,use_quota=True,user_id='dd7d11a67cec4e66a00e7931e654a545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6380962b-287a-43e2-9323-e459760ec5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6380962b-287a-43e2-9323-e459760ec5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a48193-8d9b-48ec-8ace-1cf26f9c0fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8a48193-8d9b-48ec-8ace-1cf26f9c0fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc01204e-c16b-4abe-b06e-23c263cfbbfd', 'volume_name': 'volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4bde7b-6093-4863-95f8-cb1beaac5789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d4bde7b-6093-4863-95f8-cb1beaac5789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3024676-37af-4c97-825a-72d532b49e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:28 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Volume fc01204e-c16b-4abe-b06e-23c263cfbbfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd', 'volume_size': 1} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a2ba732a-770d-4976-ac7e-2b5082d93c75 1073741824" returned: 0 in 0.846s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a2ba732a-770d-4976-ac7e-2b5082d93c75 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:28 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a2ba732a-770d-4976-ac7e-2b5082d93c75 Sep 07 14:04:28 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:28 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a2ba732a-770d-4976-ac7e-2b5082d93c75" returned: 0 in 0.276s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.538s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-934808254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5048cf99-c7bc-4482-889a-2872abebdde3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8594f0675c81499c891ff47bc5b88fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:26Z,use_quota=True,user_id='86ecaaa56942489fb7981558a2ebe579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Creating volume 5048cf99-c7bc-4482-889a-2872abebdde3 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:28 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5048cf99-c7bc-4482-889a-2872abebdde3 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebbc8c3f-5ef2-4a03-be8e-6a1a7f34e7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2ba732a-770d-4976-ac7e-2b5082d93c75', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:28 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5048cf99-c7bc-4482-889a-2872abebdde3 1073741824 Sep 07 14:04:28 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27b2a92-4d4d-4eb8-bf90-e4f589ef8a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:28 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume volume-a2ba732a-770d-4976-ac7e-2b5082d93c75 (a2ba732a-770d-4976-ac7e-2b5082d93c75): created successfully Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f27b2a92-4d4d-4eb8-bf90-e4f589ef8a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Flow 'volume_create_manager' (8bd3bd64-02e2-4157-bcdf-4016ec8885b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-de7762ea-6491-43dd-b131-9c9d9b095664 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Created volume successfully. Sep 07 14:04:29 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5048cf99-c7bc-4482-889a-2872abebdde3 1073741824" returned: 0 in 0.647s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5048cf99-c7bc-4482-889a-2872abebdde3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:29 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5048cf99-c7bc-4482-889a-2872abebdde3 Sep 07 14:04:29 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:29 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5048cf99-c7bc-4482-889a-2872abebdde3" returned: 0 in 0.315s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.652s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1424079434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe8db48e-376a-46a7-8d47-85ca49731676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8594f0675c81499c891ff47bc5b88fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:27Z,use_quota=True,user_id='86ecaaa56942489fb7981558a2ebe579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Creating volume fe8db48e-376a-46a7-8d47-85ca49731676 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:29 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe8db48e-376a-46a7-8d47-85ca49731676 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (380a6552-eeea-4c01-a10e-c9dc8b3a063b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5048cf99-c7bc-4482-889a-2872abebdde3', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fac1678-16c1-4b37-b88d-24f9fb59af8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:29 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe8db48e-376a-46a7-8d47-85ca49731676 1073741824 Sep 07 14:04:29 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:29 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume volume-5048cf99-c7bc-4482-889a-2872abebdde3 (5048cf99-c7bc-4482-889a-2872abebdde3): created successfully Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fac1678-16c1-4b37-b88d-24f9fb59af8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Flow 'volume_create_manager' (94dcfa94-3ac6-4dd1-94c1-29b628d249b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b5a0337d-8674-48de-91b5-f652452eb5af tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Created volume successfully. Sep 07 14:04:29 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:29 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:30 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.353s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 29 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 14:04:30 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe8db48e-376a-46a7-8d47-85ca49731676 1073741824" returned: 0 in 0.775s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe8db48e-376a-46a7-8d47-85ca49731676 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:30 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe8db48e-376a-46a7-8d47-85ca49731676 Sep 07 14:04:30 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:30 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe8db48e-376a-46a7-8d47-85ca49731676" returned: 0 in 0.313s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.552s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-820788246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc01204e-c16b-4abe-b06e-23c263cfbbfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd700d96db2447cbc813333f921bc7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:28Z,use_quota=True,user_id='dd7d11a67cec4e66a00e7931e654a545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Creating volume fc01204e-c16b-4abe-b06e-23c263cfbbfd {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:30 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dac48bec-d5b2-453c-87fe-c74fc77e183b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe8db48e-376a-46a7-8d47-85ca49731676', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1db40d7-1c61-4c36-84ee-f532d7270517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:30 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd 1073741824 Sep 07 14:04:30 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:30 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Volume volume-fe8db48e-376a-46a7-8d47-85ca49731676 (fe8db48e-376a-46a7-8d47-85ca49731676): created successfully Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1db40d7-1c61-4c36-84ee-f532d7270517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Flow 'volume_create_manager' (dd96f303-a8e6-4fea-a476-093655ccdc9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a35f13c5-d6ae-4ce4-a5e8-d2e49fe712f0 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Created volume successfully. Sep 07 14:04:31 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd 1073741824" returned: 0 in 0.636s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:31 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd Sep 07 14:04:31 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "cinder-fe8db48e-376a-46a7-8d47-85ca49731676-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-fe8db48e-376a-46a7-8d47-85ca49731676-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "cinder-quobyte-fe8db48e-376a-46a7-8d47-85ca49731676" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-quobyte-fe8db48e-376a-46a7-8d47-85ca49731676" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:31 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2461125-a356-400d-8f42-098f37c15736]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe8db48e-376a-46a7-8d47-85ca49731676 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:31 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd" returned: 0 in 0.370s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3024676-37af-4c97-825a-72d532b49e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (accc012f-40f2-4154-b7c7-930d3e25fc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:32 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Volume volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd (fc01204e-c16b-4abe-b06e-23c263cfbbfd): created successfully Sep 07 14:04:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (accc012f-40f2-4154-b7c7-930d3e25fc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Flow 'volume_create_manager' (95e01a47-75c3-4a16-af9c-df904037e526) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:32 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe8db48e-376a-46a7-8d47-85ca49731676 Sep 07 14:04:32 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:32 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ecfd227d-9350-4efd-9759-a27cbcd78d79 tempest-ProjectReaderTests-1222365918 None] Created volume successfully. Sep 07 14:04:32 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe8db48e-376a-46a7-8d47-85ca49731676" returned: 0 in 0.529s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe8db48e-376a-46a7-8d47-85ca49731676 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:32 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe8db48e-376a-46a7-8d47-85ca49731676 Sep 07 14:04:32 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:32 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fe8db48e-376a-46a7-8d47-85ca49731676" returned: 0 in 0.382s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-quobyte-fe8db48e-376a-46a7-8d47-85ca49731676" released by "delete_volume" :: held 0.994s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] Creating offline snapshot a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 of volume fc01204e-c16b-4abe-b06e-23c263cfbbfd {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:04:32 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Created reservations ['54e0cc14-af4f-4d8c-9615-fdfe103978df', '914026e3-0fd7-480d-89f4-fa965790ec35', '659dc572-fbf3-430a-a5f4-22858d439918', '988fd2c7-48fb-45d7-96a5-8ce944973f5b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:32 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99dac3b-38b8-4976-99b4-458b69dcb3d0]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:33 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:33 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:33 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd Sep 07 14:04:33 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:33 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.341s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Deleted volume successfully. Sep 07 14:04:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fc17c49b-ee1a-461d-b9a8-4a828a86a347 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-fe8db48e-376a-46a7-8d47-85ca49731676-delete_volume" released by "delete_volume" :: held 1.790s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:33 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd" returned: 0 in 0.566s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:33 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 1G Sep 07 14:04:33 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "cinder-5048cf99-c7bc-4482-889a-2872abebdde3-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-5048cf99-c7bc-4482-889a-2872abebdde3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:34 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "cinder-quobyte-5048cf99-c7bc-4482-889a-2872abebdde3" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 1G" returned: 0 in 0.603s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:34 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 Sep 07 14:04:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-quobyte-5048cf99-c7bc-4482-889a-2872abebdde3" acquired by "delete_volume" :: waited 0.046s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:34 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:34 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aee438a-38d8-4035-b236-bb766e6a1c24]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5048cf99-c7bc-4482-889a-2872abebdde3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:34 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5048cf99-c7bc-4482-889a-2872abebdde3 Sep 07 14:04:34 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:34 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00" returned: 0 in 0.337s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:34 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 is being set with open permissions: ugo+rw Sep 07 14:04:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:34 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 Sep 07 14:04:34 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:34 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5048cf99-c7bc-4482-889a-2872abebdde3" returned: 0 in 0.489s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5048cf99-c7bc-4482-889a-2872abebdde3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:34 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5048cf99-c7bc-4482-889a-2872abebdde3 Sep 07 14:04:34 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:34 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00" returned: 0 in 0.285s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:34 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.info Sep 07 14:04:34 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:35 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-5048cf99-c7bc-4482-889a-2872abebdde3" returned: 0 in 0.291s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-quobyte-5048cf99-c7bc-4482-889a-2872abebdde3" released by "delete_volume" :: held 0.843s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Created reservations ['fa799163-f478-409a-97b9-f1676bae49ea', 'ecae5503-72fc-4536-a413-37ba46fb2898', '06d25adf-d970-4023-86f6-145a68244ff3', '3836831d-c933-404a-a084-5c8987c7ab7e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:35 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.info" returned: 0 in 0.404s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:35 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.info is being set with open permissions: ugo+rw Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:35 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.info Sep 07 14:04:35 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:35 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:35 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "cinder-a2ba732a-770d-4976-ac7e-2b5082d93c75-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-a2ba732a-770d-4976-ac7e-2b5082d93c75-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "cinder-quobyte-a2ba732a-770d-4976-ac7e-2b5082d93c75" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-quobyte-a2ba732a-770d-4976-ac7e-2b5082d93c75" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d2eca8-865a-4b02-bcbc-de5dbd163890]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a2ba732a-770d-4976-ac7e-2b5082d93c75 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:35 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.427s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:35 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:35 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Deleted volume successfully. Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.info" returned: 0 in 0.533s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.876s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:35 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a2ba732a-770d-4976-ac7e-2b5082d93c75 Sep 07 14:04:35 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4ad3ad1b-4b26-424b-82ae-c22aeaa0fb06 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-5048cf99-c7bc-4482-889a-2872abebdde3-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:35 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e2e41ae3-17e2-444e-99cb-59cd3ae9aa33 tempest-ProjectReaderTests-1222365918 None] Create snapshot completed successfully Sep 07 14:04:36 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a2ba732a-770d-4976-ac7e-2b5082d93c75" returned: 0 in 0.616s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a2ba732a-770d-4976-ac7e-2b5082d93c75 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:36 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a2ba732a-770d-4976-ac7e-2b5082d93c75 Sep 07 14:04:36 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-quobyte-fc01204e-c16b-4abe-b06e-23c263cfbbfd" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-fc01204e-c16b-4abe-b06e-23c263cfbbfd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-quobyte-a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:36 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Deleting offline snapshot a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 of volume fc01204e-c16b-4abe-b06e-23c263cfbbfd {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] snapshot_file for this snap is: volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-a2ba732a-770d-4976-ac7e-2b5082d93c75" returned: 0 in 0.454s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06fd50b-d1ef-4172-8828-5653d6124a91]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-quobyte-a2ba732a-770d-4976-ac7e-2b5082d93c75" released by "delete_volume" :: held 1.160s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Created reservations ['35c710d1-4c37-4601-b540-dde2e9d2dad9', 'ba67a7ce-7e0a-4c20-9abb-6748940f24fe', 'de4b0a05-9324-47a0-9f09-20998c4e73af', '0e1284b2-65c1-434a-a5bc-13d91b482f34'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:36 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:36 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:36 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:36 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:37 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.270s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:37 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Deleted volume successfully. Sep 07 14:04:37 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00" returned: 0 in 0.462s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:04:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b4295f20-7782-4f6a-b6cc-e753952e82ed tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-a2ba732a-770d-4976-ac7e-2b5082d93c75-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:37 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b8d8ec-ad07-4841-b580-6f6c6dd3b949]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:37 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd Sep 07 14:04:37 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:37 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd" returned: 0 in 0.387s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:37 devstack sudo[106619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 Sep 07 14:04:37 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "cinder-eba5c0e7-1214-442a-a052-28945275667b-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-eba5c0e7-1214-442a-a052-28945275667b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:37 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=195,cinder:UPDATE=250,cinder:DELETE=22,cinder:INSERT=71 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:04:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "cinder-quobyte-eba5c0e7-1214-442a-a052-28945275667b" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-quobyte-eba5c0e7-1214-442a-a052-28945275667b" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:37 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8e59f5-faa6-4ae7-9a36-8ffa2fb4953e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eba5c0e7-1214-442a-a052-28945275667b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:38 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00" returned: 0 in 0.511s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:38 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00 Sep 07 14:04:38 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:38 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eba5c0e7-1214-442a-a052-28945275667b Sep 07 14:04:38 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:38 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd.a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00" returned: 0 in 0.432s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00" released by "_delete_snapshot" :: held 1.930s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-fc01204e-c16b-4abe-b06e-23c263cfbbfd" released by "delete_snapshot" :: held 1.965s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:38 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=189,cinder:UPDATE=266,cinder:INSERT=68,cinder:DELETE=26 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:04:38 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eba5c0e7-1214-442a-a052-28945275667b" returned: 0 in 0.610s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eba5c0e7-1214-442a-a052-28945275667b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:38 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eba5c0e7-1214-442a-a052-28945275667b Sep 07 14:04:38 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:38 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Created reservations ['226f728f-158f-4fbc-a86d-79f912293545', '994ffe9e-5961-491f-a57b-350c9e9d0f59', '0b1fde57-a0dd-4a11-bd69-64a684d532f3', 'e4eef148-f059-4bf3-af97-fb7733fa44b6'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:38 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Delete snapshot completed successfully. Sep 07 14:04:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c759022c-b806-4493-aba7-f9c993468906 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-a7bf10a3-a7f9-4b1a-aeee-60f0d0b4ad00-delete_snapshot" released by "delete_snapshot" :: held 2.218s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:38 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-eba5c0e7-1214-442a-a052-28945275667b" returned: 0 in 0.291s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-quobyte-eba5c0e7-1214-442a-a052-28945275667b" released by "delete_volume" :: held 0.952s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:38 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Created reservations ['8c91d403-df3d-4c3b-8f9d-a3444aa3744c', '60881728-2394-4424-8aac-9bd8a9c71c84', 'ec56f58d-dd32-44e1-80bd-87032d7da21e', '08046a5b-6beb-4cec-9e7e-9ee04ad05303'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:39 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:39 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:39 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.308s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:39 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:39 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Deleted volume successfully. Sep 07 14:04:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc18e5a8-385a-4abb-be6c-bdcadd2cfaa1 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-eba5c0e7-1214-442a-a052-28945275667b-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-fc01204e-c16b-4abe-b06e-23c263cfbbfd-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Lock "cinder-fc01204e-c16b-4abe-b06e-23c263cfbbfd-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-quobyte-fc01204e-c16b-4abe-b06e-23c263cfbbfd" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-fc01204e-c16b-4abe-b06e-23c263cfbbfd" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d0653a-1238-4aaf-bb9b-3762d27aff8b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "cinder-08662495-16c0-4f1b-9257-445f55236bcf-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:40 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd Sep 07 14:04:40 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-08662495-16c0-4f1b-9257-445f55236bcf-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "cinder-quobyte-08662495-16c0-4f1b-9257-445f55236bcf" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-quobyte-08662495-16c0-4f1b-9257-445f55236bcf" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace54dec-e9fa-4a48-8618-e1272f03837a]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-08662495-16c0-4f1b-9257-445f55236bcf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:40 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-08662495-16c0-4f1b-9257-445f55236bcf Sep 07 14:04:40 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:40 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd" returned: 0 in 0.542s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:40 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd Sep 07 14:04:40 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:40 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-08662495-16c0-4f1b-9257-445f55236bcf" returned: 0 in 0.467s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-08662495-16c0-4f1b-9257-445f55236bcf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:40 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-08662495-16c0-4f1b-9257-445f55236bcf Sep 07 14:04:40 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:40 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-fc01204e-c16b-4abe-b06e-23c263cfbbfd" returned: 0 in 0.398s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-fc01204e-c16b-4abe-b06e-23c263cfbbfd" released by "delete_volume" :: held 1.052s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Created reservations ['3dec5e8e-24e4-4271-a087-535ea8f4c35e', '02339373-a033-4639-a45f-ba5b70088227', 'e8f32639-7725-444b-bf69-ba1619c53232', '1d80bcb8-756e-43b4-b51d-3b1728fd53e9'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:41 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:41 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:41 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-08662495-16c0-4f1b-9257-445f55236bcf" returned: 0 in 0.527s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-quobyte-08662495-16c0-4f1b-9257-445f55236bcf" released by "delete_volume" :: held 1.052s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Created reservations ['ce852fbd-a888-467f-be2f-79207435a8bc', 'd34ca392-ca8b-4294-a84f-3f541245c925', '40fe0e57-225d-40e9-9c7f-524a7cdb8a05', 'd2a8454f-1aea-4771-b7d8-4cc150807af0'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:41 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:41 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:41 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.419s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:41 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Deleted volume successfully. Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-88e09a00-c224-412d-b603-91f5d192772c tempest-ProjectReaderTests-1222365918 None] Lock "cinder-fc01204e-c16b-4abe-b06e-23c263cfbbfd-delete_volume" released by "delete_volume" :: held 1.908s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:41 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.314s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:41 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Deleted volume successfully. Sep 07 14:04:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dfda44fa-5b52-4ba5-97a7-a77e8a303691 tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-08662495-16c0-4f1b-9257-445f55236bcf-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "cinder-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "cinder-quobyte-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-quobyte-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:42 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d1624d-ed47-4235-8787-a8a07c3eb1f3]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:42 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Flow 'volume_create_manager' (2cddb199-5105-4b80-88b6-96b76c83087c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110bfa84-fe3e-495b-bea3-2b1023bc6dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (110bfa84-fe3e-495b-bea3-2b1023bc6dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-956414475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=973482d4-6b29-4bda-808a-494cfa4332c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd700d96db2447cbc813333f921bc7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:43Z,use_quota=True,user_id='dd7d11a67cec4e66a00e7931e654a545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade50eeb-8bac-4f8e-b8b8-521c55433d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade50eeb-8bac-4f8e-b8b8-521c55433d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925c73d1-20f7-4135-903f-ffb415e4e40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (925c73d1-20f7-4135-903f-ffb415e4e40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '973482d4-6b29-4bda-808a-494cfa4332c1', 'volume_name': 'volume-973482d4-6b29-4bda-808a-494cfa4332c1', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:43 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f074cd86-a715-46b6-adec-426bfdbb8153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:43 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f074cd86-a715-46b6-adec-426bfdbb8153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b061ffef-5150-4a2d-b690-9e73c9bf1807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:43 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Volume 973482d4-6b29-4bda-808a-494cfa4332c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-973482d4-6b29-4bda-808a-494cfa4332c1', 'volume_size': 1} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-956414475',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=973482d4-6b29-4bda-808a-494cfa4332c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd700d96db2447cbc813333f921bc7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:43Z,use_quota=True,user_id='dd7d11a67cec4e66a00e7931e654a545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Creating volume 973482d4-6b29-4bda-808a-494cfa4332c1 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:43 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:43 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1 1073741824 Sep 07 14:04:43 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:43 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f" returned: 0 in 0.626s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:43 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f Sep 07 14:04:43 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:43 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1 1073741824" returned: 0 in 0.752s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Flow 'volume_create_manager' (26e79bfd-0d6b-4647-8aa4-25006eed0a04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec25dc19-9669-4b8a-bf09-b9cc1e0c2015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:43 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec25dc19-9669-4b8a-bf09-b9cc1e0c2015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072757510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc33a6c942374a0781a4b69f7f4ca7fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:44Z,use_quota=True,user_id='5c39d8f0a53342ec9d3ad2b8db51d3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092d2ab8-62e2-4b4d-ba31-db736e0b2dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:44 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1 Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (092d2ab8-62e2-4b4d-ba31-db736e0b2dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:44 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb5dcbe-629b-4c25-a813-baa18230b4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fb5dcbe-629b-4c25-a813-baa18230b4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5c8ff2e-3f30-4f7a-8350-e6eb775a48ec', 'volume_name': 'volume-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22fb5f60-b323-4a58-8a75-d2a8daff6b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22fb5f60-b323-4a58-8a75-d2a8daff6b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e9ed4a0-e0ad-4063-add7-af1d15ed7b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Volume d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec', 'volume_size': 1} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f" returned: 0 in 0.542s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-quobyte-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f" released by "delete_volume" :: held 1.238s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Created reservations ['ce84722b-b560-472b-aa47-1c15e9673a58', '6248c7af-c0ff-4bb3-b6b6-25ca97279015', '794a6525-7d68-456b-8af9-273bf304fe75', '91873308-6aad-44f7-b25e-a785b8c4942d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:44 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:44 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:44 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1" returned: 0 in 0.399s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.351s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1072757510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc33a6c942374a0781a4b69f7f4ca7fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:44Z,use_quota=True,user_id='5c39d8f0a53342ec9d3ad2b8db51d3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Creating volume d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:44 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b061ffef-5150-4a2d-b690-9e73c9bf1807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-973482d4-6b29-4bda-808a-494cfa4332c1', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054385d8-bf83-4c8c-8698-aff6da2c2ef1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:44 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec 1073741824 Sep 07 14:04:44 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Volume volume-973482d4-6b29-4bda-808a-494cfa4332c1 (973482d4-6b29-4bda-808a-494cfa4332c1): created successfully Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (054385d8-bf83-4c8c-8698-aff6da2c2ef1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Flow 'volume_create_manager' (2cddb199-5105-4b80-88b6-96b76c83087c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ea3f5d74-146a-4d63-a35f-cd87cdeed2cc tempest-ProjectReaderTests-1222365918 None] Created volume successfully. Sep 07 14:04:44 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.327s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Deleted volume successfully. Sep 07 14:04:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4da7d971-854f-43b8-89a3-cc29f960b37f tempest-CreateVolumesFromSourceVolumeTest-1298729999 None] Lock "cinder-2c60796a-30a2-4d70-ba52-0b8cf5fdd48f-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:45 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec 1073741824" returned: 0 in 0.622s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:45 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec Sep 07 14:04:45 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:45 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec" returned: 0 in 0.496s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.238s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] Creating offline snapshot b9b0779a-e7e8-4356-af48-99d6d8d40722 of volume 973482d4-6b29-4bda-808a-494cfa4332c1 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:04:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e9ed4a0-e0ad-4063-add7-af1d15ed7b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016206a1-fe3a-4dc4-bfae-1cc4435e193c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:45 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd246ef3-d135-480a-8cc8-b47c264da5b8]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:45 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Volume volume-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec (d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec): created successfully Sep 07 14:04:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (016206a1-fe3a-4dc4-bfae-1cc4435e193c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Flow 'volume_create_manager' (26e79bfd-0d6b-4647-8aa4-25006eed0a04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-99ae3c7e-f429-4c25-a3c0-3f21b7807df6 tempest-ProjectReaderTests-1362761481 None] Created volume successfully. Sep 07 14:04:45 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1 Sep 07 14:04:45 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:46 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1" returned: 0 in 0.535s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:46 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722 1G Sep 07 14:04:46 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "cinder-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Lock "cinder-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "cinder-quobyte-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Lock "cinder-quobyte-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4be340d-c586-4d87-b7f3-848cd5214e1f]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:46 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722 1G" returned: 0 in 0.656s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-973482d4-6b29-4bda-808a-494cfa4332c1 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:46 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-973482d4-6b29-4bda-808a-494cfa4332c1 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722 Sep 07 14:04:46 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:46 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec Sep 07 14:04:46 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Flow 'volume_create_manager' (1687eec2-9e15-4af7-9646-98bcd3f392df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275dc20d-44c0-47a1-9bb1-f77cfc283f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:47 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (275dc20d-44c0-47a1-9bb1-f77cfc283f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1911061673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adad61a-0a42-4b32-9872-17579f5151ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ccf9c4fdbb4a1cac0c29de54fedbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:47Z,use_quota=True,user_id='182d4afacb464a54a699adce66896c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66dbcbf9-b81f-4ae4-bdc0-08136c9ebdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:47 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66dbcbf9-b81f-4ae4-bdc0-08136c9ebdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e09b5ca-b558-4656-8ca3-e7426c4171d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e09b5ca-b558-4656-8ca3-e7426c4171d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1adad61a-0a42-4b32-9872-17579f5151ea', 'volume_name': 'volume-1adad61a-0a42-4b32-9872-17579f5151ea', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab21944-7846-48f9-b465-0c107d3788ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ab21944-7846-48f9-b465-0c107d3788ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb7cb5a-eb82-4672-aa7b-4e3a89fce542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:47 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Volume 1adad61a-0a42-4b32-9872-17579f5151ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1adad61a-0a42-4b32-9872-17579f5151ea', 'volume_size': 1} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec" returned: 0 in 0.577s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-973482d4-6b29-4bda-808a-494cfa4332c1 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722" returned: 0 in 0.470s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:47 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722 is being set with open permissions: ugo+rw Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:47 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec Sep 07 14:04:47 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:47 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722 Sep 07 14:04:47 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:47 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:47 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722" returned: 0 in 0.278s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec" returned: 0 in 0.295s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Lock "cinder-quobyte-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec" released by "delete_volume" :: held 0.926s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:47 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.info Sep 07 14:04:47 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Created reservations ['286a3db6-ee66-4293-b07b-5e17625ef315', '6ebb6efe-23d6-4890-960a-3ce712c7aeb9', '043e9546-a832-4528-9287-bb36f13dc792', 'aaa3cf4f-95fc-463c-8c24-07af96e3f4f8'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:47 devstack sudo[106722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:47 devstack sudo[106722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:48 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.info" returned: 0 in 0.359s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:48 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.info is being set with open permissions: ugo+rw Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:48 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.info Sep 07 14:04:48 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:48 devstack sudo[106722]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.343s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:48 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Deleted volume successfully. Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f191bf32-029d-4b79-88fb-c5c8c34523e2 tempest-ProjectReaderTests-1362761481 None] Lock "cinder-d5c8ff2e-3f30-4f7a-8350-e6eb775a48ec-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:48 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.info" returned: 0 in 0.391s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.853s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.106s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1911061673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1adad61a-0a42-4b32-9872-17579f5151ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ccf9c4fdbb4a1cac0c29de54fedbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:47Z,use_quota=True,user_id='182d4afacb464a54a699adce66896c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Creating volume 1adad61a-0a42-4b32-9872-17579f5151ea {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:48 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:48 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea 1073741824 Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:48 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Flow 'volume_create_manager' (0d4bd652-4661-45f1-b573-7ee5d5f12fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e547a9c9-269a-459e-b0a7-dcf5624ec108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e547a9c9-269a-459e-b0a7-dcf5624ec108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-178961692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59abfed6-3ce6-4996-b528-d2a7f22794c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc33a6c942374a0781a4b69f7f4ca7fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:48Z,use_quota=True,user_id='5c39d8f0a53342ec9d3ad2b8db51d3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1c6cba-61a6-4aa0-99eb-0bae791fc114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c1c6cba-61a6-4aa0-99eb-0bae791fc114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da237f3-a708-40dd-9cd8-60f05f7906a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1da237f3-a708-40dd-9cd8-60f05f7906a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59abfed6-3ce6-4996-b528-d2a7f22794c0', 'volume_name': 'volume-59abfed6-3ce6-4996-b528-d2a7f22794c0', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412f34a6-1b8e-480c-b80a-79a22003ca4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (412f34a6-1b8e-480c-b80a-79a22003ca4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375d01b0-a5d4-47b3-8514-52090acd2866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:48 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Volume 59abfed6-3ce6-4996-b528-d2a7f22794c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59abfed6-3ce6-4996-b528-d2a7f22794c0', 'volume_size': 1} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:48 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7747c7af-02c5-4e57-9da6-54ff899fb770 tempest-ProjectReaderTests-1222365918 None] Create snapshot completed successfully Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-b9b0779a-e7e8-4356-af48-99d6d8d40722-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-b9b0779a-e7e8-4356-af48-99d6d8d40722-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-quobyte-973482d4-6b29-4bda-808a-494cfa4332c1" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-973482d4-6b29-4bda-808a-494cfa4332c1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-quobyte-b9b0779a-e7e8-4356-af48-99d6d8d40722" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-b9b0779a-e7e8-4356-af48-99d6d8d40722" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Deleting offline snapshot b9b0779a-e7e8-4356-af48-99d6d8d40722 of volume 973482d4-6b29-4bda-808a-494cfa4332c1 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] snapshot_file for this snap is: volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[95355504-70dd-4b76-8381-77e75307c359]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:48 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722 Sep 07 14:04:48 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:48 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea 1073741824" returned: 0 in 0.497s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:49 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea Sep 07 14:04:49 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:49 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722" returned: 0 in 0.430s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-973482d4-6b29-4bda-808a-494cfa4332c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efef56b-0a3a-4a42-a408-59097125f84e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:49 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea" returned: 0 in 0.325s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.752s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-178961692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59abfed6-3ce6-4996-b528-d2a7f22794c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc33a6c942374a0781a4b69f7f4ca7fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:48Z,use_quota=True,user_id='5c39d8f0a53342ec9d3ad2b8db51d3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Creating volume 59abfed6-3ce6-4996-b528-d2a7f22794c0 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:49 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-59abfed6-3ce6-4996-b528-d2a7f22794c0 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4eb7cb5a-eb82-4672-aa7b-4e3a89fce542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1adad61a-0a42-4b32-9872-17579f5151ea', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553afffc-e67f-4567-9ead-01f481c9066e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:49 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-59abfed6-3ce6-4996-b528-d2a7f22794c0 1073741824 Sep 07 14:04:49 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:49 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Volume volume-1adad61a-0a42-4b32-9872-17579f5151ea (1adad61a-0a42-4b32-9872-17579f5151ea): created successfully Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (553afffc-e67f-4567-9ead-01f481c9066e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Flow 'volume_create_manager' (1687eec2-9e15-4af7-9646-98bcd3f392df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6caa27c0-05a8-40ad-af34-003fb7a49d0a tempest-SnapshotDependencyTests-1435717787 None] Created volume successfully. Sep 07 14:04:49 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1 Sep 07 14:04:49 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:49 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1" returned: 0 in 0.501s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:49 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722 Sep 07 14:04:49 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2a52712b-0aa3-4fdb-8417-7275dc2c692f tempest-ProjectAdminTests-915991872 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.5802955627441, 'free_capacity_gb': 1773.5802955627441, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87444) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 07 14:04:49 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-59abfed6-3ce6-4996-b528-d2a7f22794c0 1073741824" returned: 0 in 0.542s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-59abfed6-3ce6-4996-b528-d2a7f22794c0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:49 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-59abfed6-3ce6-4996-b528-d2a7f22794c0 Sep 07 14:04:49 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:50 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722" returned: 0 in 0.400s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:50 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722 Sep 07 14:04:50 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:50 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-59abfed6-3ce6-4996-b528-d2a7f22794c0" returned: 0 in 0.288s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375d01b0-a5d4-47b3-8514-52090acd2866) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59abfed6-3ce6-4996-b528-d2a7f22794c0', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (679bc127-5a0c-4791-aaca-3fbb00360c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:50 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Volume volume-59abfed6-3ce6-4996-b528-d2a7f22794c0 (59abfed6-3ce6-4996-b528-d2a7f22794c0): created successfully Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (679bc127-5a0c-4791-aaca-3fbb00360c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Flow 'volume_create_manager' (0d4bd652-4661-45f1-b573-7ee5d5f12fb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b583c96c-2703-4390-8806-016510c2a6c3 tempest-ProjectReaderTests-1362761481 None] Created volume successfully. Sep 07 14:04:50 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1.b9b0779a-e7e8-4356-af48-99d6d8d40722" returned: 0 in 0.343s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-b9b0779a-e7e8-4356-af48-99d6d8d40722" released by "_delete_snapshot" :: held 1.819s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-973482d4-6b29-4bda-808a-494cfa4332c1" released by "delete_snapshot" :: held 1.851s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "cinder-59abfed6-3ce6-4996-b528-d2a7f22794c0-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Lock "cinder-59abfed6-3ce6-4996-b528-d2a7f22794c0-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Created reservations ['da2127ef-b56a-4bf0-bad4-e2c8e58507b7', '612fdf96-6d50-46ef-8e8e-6930024a1832', 'be0c5128-76e8-40f7-b95d-679dbafa48f2', '2fec9ac0-f930-4cef-8982-e0bdc90846e2'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "cinder-quobyte-59abfed6-3ce6-4996-b528-d2a7f22794c0" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Lock "cinder-quobyte-59abfed6-3ce6-4996-b528-d2a7f22794c0" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49922c5-a0dd-47e6-9912-a95e4908998e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-59abfed6-3ce6-4996-b528-d2a7f22794c0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Delete snapshot completed successfully. Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-973482d4-6b29-4bda-808a-494cfa4332c1-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] Creating offline snapshot f5eddf83-873a-497f-a0ae-3323159a33d2 of volume 1adad61a-0a42-4b32-9872-17579f5151ea {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bad91ab5-4f70-49e3-9ef6-f931ea5e5ee6 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-b9b0779a-e7e8-4356-af48-99d6d8d40722-delete_snapshot" released by "delete_snapshot" :: held 2.237s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Lock "cinder-973482d4-6b29-4bda-808a-494cfa4332c1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[681f96c6-4218-4916-86a3-84fb63195cd3]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-quobyte-973482d4-6b29-4bda-808a-494cfa4332c1" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:51 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-59abfed6-3ce6-4996-b528-d2a7f22794c0 Sep 07 14:04:51 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-973482d4-6b29-4bda-808a-494cfa4332c1" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[479dc101-89ba-48d1-a76d-512b8d2b65a8]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:51 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea Sep 07 14:04:51 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:51 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1 Sep 07 14:04:51 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:51 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-59abfed6-3ce6-4996-b528-d2a7f22794c0" returned: 0 in 0.572s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-59abfed6-3ce6-4996-b528-d2a7f22794c0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:51 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea" returned: 0 in 0.446s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:51 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-59abfed6-3ce6-4996-b528-d2a7f22794c0 Sep 07 14:04:51 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:51 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 1G Sep 07 14:04:51 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:51 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:51 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1" returned: 0 in 0.589s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-59abfed6-3ce6-4996-b528-d2a7f22794c0" returned: 0 in 0.295s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Lock "cinder-quobyte-59abfed6-3ce6-4996-b528-d2a7f22794c0" released by "delete_volume" :: held 0.965s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:51 devstack sudo[106824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1 Sep 07 14:04:51 devstack sudo[106824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Created reservations ['4d340b89-d0a9-4d36-83d9-26a5841092f7', '60283ecf-da7d-44a5-818f-f0e9beba928e', '0b3a049d-06a5-4861-99e9-0e153d0ce300', 'e3ae4abc-6340-4f93-a113-edd4c88f0577'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:51 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:51 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:52 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 1G" returned: 0 in 0.623s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1adad61a-0a42-4b32-9872-17579f5151ea -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:52 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1adad61a-0a42-4b32-9872-17579f5151ea -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 Sep 07 14:04:52 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:52 devstack sudo[106824]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-973482d4-6b29-4bda-808a-494cfa4332c1" returned: 0 in 0.488s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-973482d4-6b29-4bda-808a-494cfa4332c1" released by "delete_volume" :: held 1.156s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:52 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Created reservations ['94210d61-de30-420b-942b-15027d7b311d', '52731699-b3f7-4f9d-89a6-f3ed745d2e3a', '1b3fab5c-2886-439d-8ae3-5162d777467b', '08ff5af8-0691-4367-8f37-0117f689eaf4'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.378s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Deleted volume successfully. Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8a4bd82f-6792-42ff-988a-ebd65d82c4e0 tempest-ProjectReaderTests-1362761481 None] Lock "cinder-59abfed6-3ce6-4996-b528-d2a7f22794c0-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:52 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1adad61a-0a42-4b32-9872-17579f5151ea -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2" returned: 0 in 0.396s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:52 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 is being set with open permissions: ugo+rw Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:52 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:52 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:52 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 Sep 07 14:04:52 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:52 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.283s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Deleted volume successfully. Sep 07 14:04:52 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2" returned: 0 in 0.288s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1134a4b5-6380-40a1-8e33-a9180a61ae3c tempest-ProjectReaderTests-1222365918 None] Lock "cinder-973482d4-6b29-4bda-808a-494cfa4332c1-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:52 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.info Sep 07 14:04:52 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:53 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.info" returned: 0 in 0.292s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:53 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.info is being set with open permissions: ugo+rw Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:53 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.info Sep 07 14:04:53 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:53 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.info" returned: 0 in 0.333s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.537s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-49f65237-683d-4fad-9edc-079de9166967 tempest-SnapshotDependencyTests-1435717787 None] Create snapshot completed successfully Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Flow 'volume_create_manager' (10dc3545-ee81-4649-a1bc-bbbe80ec0a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33536da-406e-4d0f-bfcf-45b86b2d0668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d33536da-406e-4d0f-bfcf-45b86b2d0668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093946649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ade3e8d-4978-4972-9514-3e1a5b3054e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc33a6c942374a0781a4b69f7f4ca7fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:54Z,use_quota=True,user_id='5c39d8f0a53342ec9d3ad2b8db51d3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07db0930-cb61-49ed-b108-963693f403eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07db0930-cb61-49ed-b108-963693f403eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175f76f6-7142-4cd5-92a0-fbd83819a431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (175f76f6-7142-4cd5-92a0-fbd83819a431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ade3e8d-4978-4972-9514-3e1a5b3054e5', 'volume_name': 'volume-4ade3e8d-4978-4972-9514-3e1a5b3054e5', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6894900c-ee9b-44be-8f0e-b6eb89546e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6894900c-ee9b-44be-8f0e-b6eb89546e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30095eb-ffa4-47b5-8c62-a58fdcf18f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Volume 4ade3e8d-4978-4972-9514-3e1a5b3054e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ade3e8d-4978-4972-9514-3e1a5b3054e5', 'volume_size': 1} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1093946649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ade3e8d-4978-4972-9514-3e1a5b3054e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc33a6c942374a0781a4b69f7f4ca7fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:54Z,use_quota=True,user_id='5c39d8f0a53342ec9d3ad2b8db51d3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Creating volume 4ade3e8d-4978-4972-9514-3e1a5b3054e5 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:53 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4ade3e8d-4978-4972-9514-3e1a5b3054e5 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:53 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4ade3e8d-4978-4972-9514-3e1a5b3054e5 1073741824 Sep 07 14:04:53 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Flow 'volume_create_manager' (2624fb78-9da8-4f6c-bfbf-e78488299380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e492cb-6dad-4c3e-8286-3ea1f3c4161d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3e492cb-6dad-4c3e-8286-3ea1f3c4161d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1283236724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcca75f-3550-4471-b847-2fc940bdb44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd700d96db2447cbc813333f921bc7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:54Z,use_quota=True,user_id='dd7d11a67cec4e66a00e7931e654a545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9127d9b-aa75-4959-bd30-af783cd23124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9127d9b-aa75-4959-bd30-af783cd23124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3388b2-d16f-44ea-bee4-db9faacb471e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e3388b2-d16f-44ea-bee4-db9faacb471e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dcca75f-3550-4471-b847-2fc940bdb44a', 'volume_name': 'volume-4dcca75f-3550-4471-b847-2fc940bdb44a', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f88748-0514-4f62-8a06-fcebd48b7a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8f88748-0514-4f62-8a06-fcebd48b7a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce6c976-a67a-49b7-8997-4f81fb596ae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:54 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Volume 4dcca75f-3550-4471-b847-2fc940bdb44a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dcca75f-3550-4471-b847-2fc940bdb44a', 'volume_size': 1} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:54 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4ade3e8d-4978-4972-9514-3e1a5b3054e5 1073741824" returned: 0 in 0.538s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4ade3e8d-4978-4972-9514-3e1a5b3054e5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:54 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4ade3e8d-4978-4972-9514-3e1a5b3054e5 Sep 07 14:04:54 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:54 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4ade3e8d-4978-4972-9514-3e1a5b3054e5" returned: 0 in 0.285s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.519s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1283236724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dcca75f-3550-4471-b847-2fc940bdb44a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd700d96db2447cbc813333f921bc7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:54Z,use_quota=True,user_id='dd7d11a67cec4e66a00e7931e654a545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Creating volume 4dcca75f-3550-4471-b847-2fc940bdb44a {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:54 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f30095eb-ffa4-47b5-8c62-a58fdcf18f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ade3e8d-4978-4972-9514-3e1a5b3054e5', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:54 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a 1073741824 Sep 07 14:04:54 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce07a19-a200-4946-a8fb-1ac39271fe79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:54 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Volume volume-4ade3e8d-4978-4972-9514-3e1a5b3054e5 (4ade3e8d-4978-4972-9514-3e1a5b3054e5): created successfully Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ce07a19-a200-4946-a8fb-1ac39271fe79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Flow 'volume_create_manager' (10dc3545-ee81-4649-a1bc-bbbe80ec0a06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1622bbf0-8264-4874-8789-51e52396d4e0 tempest-ProjectReaderTests-1362761481 None] Created volume successfully. Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Flow 'volume_create_manager' (4f0b7652-becf-4ed5-a6d9-bd6266819ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5734fd82-9e87-4ec2-8587-cf8d987dde3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5734fd82-9e87-4ec2-8587-cf8d987dde3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:54Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3525da4f-873b-4422-886d-058c51ea3cab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60ccf9c4fdbb4a1cac0c29de54fedbb7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f5eddf83-873a-497f-a0ae-3323159a33d2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:55Z,use_quota=True,user_id='182d4afacb464a54a699adce66896c71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ab8d85-f8e1-486b-81a0-f1d4babff7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9ab8d85-f8e1-486b-81a0-f1d4babff7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38064c33-2866-46b9-8cd7-adb3dfb2cc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38064c33-2866-46b9-8cd7-adb3dfb2cc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3525da4f-873b-4422-886d-058c51ea3cab', 'volume_name': 'volume-3525da4f-873b-4422-886d-058c51ea3cab', 'volume_size': 1, 'snapshot_id': 'f5eddf83-873a-497f-a0ae-3323159a33d2'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8def60ec-d787-4090-999a-d88a32b3f116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8def60ec-d787-4090-999a-d88a32b3f116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2759847a-a3b6-48fa-af7e-53089782ed29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:54 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Volume 3525da4f-873b-4422-886d-058c51ea3cab: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3525da4f-873b-4422-886d-058c51ea3cab', 'volume_size': 1, 'snapshot_id': 'f5eddf83-873a-497f-a0ae-3323159a33d2'} Sep 07 14:04:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:55 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a 1073741824" returned: 0 in 0.578s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:55 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a Sep 07 14:04:55 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:55 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a" returned: 0 in 0.319s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.606s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "cinder-quobyte-f5eddf83-873a-497f-a0ae-3323159a33d2-3525da4f-873b-4422-886d-058c51ea3cab" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fce6c976-a67a-49b7-8997-4f81fb596ae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dcca75f-3550-4471-b847-2fc940bdb44a', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f6d34c-91d9-465f-b459-101f03ca9c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-quobyte-f5eddf83-873a-497f-a0ae-3323159a33d2-3525da4f-873b-4422-886d-058c51ea3cab" acquired by "_create_volume_from_snapshot" :: waited 0.053s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Creating volume 3525da4f-873b-4422-886d-058c51ea3cab from snapshot f5eddf83-873a-497f-a0ae-3323159a33d2 {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "cinder-quobyte-3525da4f-873b-4422-886d-058c51ea3cab" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:55 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Volume volume-4dcca75f-3550-4471-b847-2fc940bdb44a (4dcca75f-3550-4471-b847-2fc940bdb44a): created successfully Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9f6d34c-91d9-465f-b459-101f03ca9c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Flow 'volume_create_manager' (2624fb78-9da8-4f6c-bfbf-e78488299380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-quobyte-3525da4f-873b-4422-886d-058c51ea3cab" acquired by "_copy_volume_from_snapshot" :: waited 0.039s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] snapshot: f5eddf83-873a-497f-a0ae-3323159a33d2, volume: 3525da4f-873b-4422-886d-058c51ea3cab, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 07 14:04:55 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-09f77013-2ea2-4e1b-b059-ddced9b7f12b tempest-ProjectReaderTests-1222365918 None] Created volume successfully. Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cd2415-4a38-43be-8551-08b2f6da638b]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "cinder-4ade3e8d-4978-4972-9514-3e1a5b3054e5-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Lock "cinder-4ade3e8d-4978-4972-9514-3e1a5b3054e5-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "cinder-quobyte-4ade3e8d-4978-4972-9514-3e1a5b3054e5" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:04:55 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 Sep 07 14:04:55 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Lock "cinder-quobyte-4ade3e8d-4978-4972-9514-3e1a5b3054e5" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8e87147-ae7a-4bb6-a0b6-bb3af332c41e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4ade3e8d-4978-4972-9514-3e1a5b3054e5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:56 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4ade3e8d-4978-4972-9514-3e1a5b3054e5 Sep 07 14:04:56 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:56 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2" returned: 0 in 0.512s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1adad61a-0a42-4b32-9872-17579f5151ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c29d061-e65f-45b3-8841-3a1c4463bd05]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:56 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea Sep 07 14:04:56 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:56 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4ade3e8d-4978-4972-9514-3e1a5b3054e5" returned: 0 in 0.459s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4ade3e8d-4978-4972-9514-3e1a5b3054e5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:56 devstack sudo[106882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4ade3e8d-4978-4972-9514-3e1a5b3054e5 Sep 07 14:04:56 devstack sudo[106882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:56 devstack sudo[106882]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4ade3e8d-4978-4972-9514-3e1a5b3054e5" returned: 0 in 0.260s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:56 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea" returned: 0 in 0.454s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] will copy from snapshot at /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Path /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3525da4f-873b-4422-886d-058c51ea3cab not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3525da4f-873b-4422-886d-058c51ea3cab {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Lock "cinder-quobyte-4ade3e8d-4978-4972-9514-3e1a5b3054e5" released by "delete_volume" :: held 0.810s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:56 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3525da4f-873b-4422-886d-058c51ea3cab Sep 07 14:04:56 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Created reservations ['add860d2-4cc8-46d5-bcb6-a2c467c91beb', '09ff2afa-e152-4f74-b6bb-fb7cdb95f5a0', '14d9e73a-bd86-4257-909a-f89fa790ba59', 'a17c98a5-d1d7-4d20-8d00-13da586ef0a7'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:04:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:04:56 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:04:56 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:04:57 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Sep 07 14:04:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.393s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:04:57 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:04:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Deleted volume successfully. Sep 07 14:04:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-672a8759-835c-4849-8362-438ea5107608 tempest-ProjectReaderTests-1362761481 None] Lock "cinder-4ade3e8d-4978-4972-9514-3e1a5b3054e5-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:04:58 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:04:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Flow 'volume_create_manager' (b02de5e9-af2d-4228-a79f-aad659406084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:04:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ff0391-d08f-4a4e-98c1-5aed886a150c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7ff0391-d08f-4a4e-98c1-5aed886a150c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677904394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ad40cd-65fb-4ad9-907f-ced7cb5d620d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc33a6c942374a0781a4b69f7f4ca7fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:58Z,use_quota=True,user_id='5c39d8f0a53342ec9d3ad2b8db51d3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f5813a-9f0d-4437-a2a4-9bea08bd753e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f5813a-9f0d-4437-a2a4-9bea08bd753e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e22ede4-5843-44c6-b2dd-52f2c121fc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e22ede4-5843-44c6-b2dd-52f2c121fc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98ad40cd-65fb-4ad9-907f-ced7cb5d620d', 'volume_name': 'volume-98ad40cd-65fb-4ad9-907f-ced7cb5d620d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94ef1c7-8ccb-41dc-935a-038497587b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f94ef1c7-8ccb-41dc-935a-038497587b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:04:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf7c657-68a8-499b-a0bc-ba88523df875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:04:58 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Volume 98ad40cd-65fb-4ad9-907f-ced7cb5d620d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98ad40cd-65fb-4ad9-907f-ced7cb5d620d', 'volume_size': 1} Sep 07 14:04:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:02 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3525da4f-873b-4422-886d-058c51ea3cab" returned: 0 in 5.345s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Image conversion details: src /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3525da4f-873b-4422-886d-058c51ea3cab {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 07 14:05:02 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Converted 1024.00 MB image at 191.55 MB/s Sep 07 14:05:02 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3525da4f-873b-4422-886d-058c51ea3cab is being set with open permissions: ugo+rw Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3525da4f-873b-4422-886d-058c51ea3cab {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:02 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3525da4f-873b-4422-886d-058c51ea3cab Sep 07 14:05:02 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:02 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3525da4f-873b-4422-886d-058c51ea3cab" returned: 0 in 0.255s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-quobyte-3525da4f-873b-4422-886d-058c51ea3cab" released by "_copy_volume_from_snapshot" :: held 6.699s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-quobyte-f5eddf83-873a-497f-a0ae-3323159a33d2-3525da4f-873b-4422-886d-058c51ea3cab" released by "_create_volume_from_snapshot" :: held 6.802s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.857s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.084s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] Creating offline snapshot 039df6ea-21a1-486b-8741-b03446f36e99 of volume 4dcca75f-3550-4471-b847-2fc940bdb44a {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2759847a-a3b6-48fa-af7e-53089782ed29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3525da4f-873b-4422-886d-058c51ea3cab', 'volume_size': 1, 'snapshot_id': 'f5eddf83-873a-497f-a0ae-3323159a33d2'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28c689a-007d-4a16-96de-2d431d615619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c87381-5fb6-4b65-9b05-7e90f9e46027]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:02 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Volume volume-3525da4f-873b-4422-886d-058c51ea3cab (3525da4f-873b-4422-886d-058c51ea3cab): created successfully Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28c689a-007d-4a16-96de-2d431d615619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Flow 'volume_create_manager' (4f0b7652-becf-4ed5-a6d9-bd6266819ee3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:02 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-bb43e1b6-c49f-4529-8a4d-a4494120f267 tempest-SnapshotDependencyTests-1435717787 None] Created volume successfully. Sep 07 14:05:02 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a Sep 07 14:05:02 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "cinder-f5eddf83-873a-497f-a0ae-3323159a33d2-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-f5eddf83-873a-497f-a0ae-3323159a33d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "cinder-quobyte-1adad61a-0a42-4b32-9872-17579f5151ea" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-quobyte-1adad61a-0a42-4b32-9872-17579f5151ea" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "cinder-quobyte-f5eddf83-873a-497f-a0ae-3323159a33d2" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-quobyte-f5eddf83-873a-497f-a0ae-3323159a33d2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Deleting offline snapshot f5eddf83-873a-497f-a0ae-3323159a33d2 of volume 1adad61a-0a42-4b32-9872-17579f5151ea {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] snapshot_file for this snap is: volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[304a239e-a30c-44c8-b557-d5bd6cf51287]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:02 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a" returned: 0 in 0.493s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:02 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99 1G Sep 07 14:05:02 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:03 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 Sep 07 14:05:03 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:03 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (d336082c-95d0-4409-9622-1c35cc0d8018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36dea33d-7a78-4b7d-b254-23915c6888f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2" returned: 0 in 0.510s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1adad61a-0a42-4b32-9872-17579f5151ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:03 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99 1G" returned: 0 in 0.523s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dcca75f-3550-4471-b847-2fc940bdb44a -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2db12c6-1c9b-461c-9e4a-8de046a19b8d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:03 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dcca75f-3550-4471-b847-2fc940bdb44a -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99 Sep 07 14:05:03 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36dea33d-7a78-4b7d-b254-23915c6888f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1616304488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad9a55f-dda0-4e1c-9059-22cd5df5a35b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:03Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a2b906-b1ee-4fcd-97bd-8068b14c9643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26a2b906-b1ee-4fcd-97bd-8068b14c9643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b6b7ad-6181-4a25-9f54-2d5f418fbc7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b6b7ad-6181-4a25-9f54-2d5f418fbc7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ad9a55f-dda0-4e1c-9059-22cd5df5a35b', 'volume_name': 'volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6b3be4-ee8c-4deb-aba3-a439ac619f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba6b3be4-ee8c-4deb-aba3-a439ac619f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5579f3b-f79b-4ebc-994f-262bd4982a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:03 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Volume 8ad9a55f-dda0-4e1c-9059-22cd5df5a35b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b', 'volume_size': 1} Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:03 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea Sep 07 14:05:03 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:03 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4dcca75f-3550-4471-b847-2fc940bdb44a -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99" returned: 0 in 0.318s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:03 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99 is being set with open permissions: ugo+rw Sep 07 14:05:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:03 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99 Sep 07 14:05:03 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:04 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea" returned: 0 in 0.554s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:04 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99" returned: 0 in 0.275s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:04 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 Sep 07 14:05:04 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:04 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.info Sep 07 14:05:04 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:04 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.info" returned: 0 in 0.258s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:04 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.info is being set with open permissions: ugo+rw Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:04 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.info Sep 07 14:05:04 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:04 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2" returned: 0 in 0.397s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:04 devstack sudo[106957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2 Sep 07 14:05:04 devstack sudo[106957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:04 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.info" returned: 0 in 0.265s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.239s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:04:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1677904394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98ad40cd-65fb-4ad9-907f-ced7cb5d620d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc33a6c942374a0781a4b69f7f4ca7fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:04:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:04:58Z,use_quota=True,user_id='5c39d8f0a53342ec9d3ad2b8db51d3a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Creating volume 98ad40cd-65fb-4ad9-907f-ced7cb5d620d {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:04 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98ad40cd-65fb-4ad9-907f-ced7cb5d620d 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:04 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98ad40cd-65fb-4ad9-907f-ced7cb5d620d 1073741824 Sep 07 14:05:04 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8c4804ff-7d95-4a5b-9b08-0c39561b1021 tempest-ProjectReaderTests-1222365918 None] Create snapshot completed successfully Sep 07 14:05:04 devstack sudo[106957]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea.f5eddf83-873a-497f-a0ae-3323159a33d2" returned: 0 in 0.292s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-quobyte-f5eddf83-873a-497f-a0ae-3323159a33d2" released by "_delete_snapshot" :: held 1.886s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-quobyte-1adad61a-0a42-4b32-9872-17579f5151ea" released by "delete_snapshot" :: held 1.916s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Created reservations ['632e7417-d489-4d6d-bf5e-0e30db245456', 'b8bbecc0-b70c-4f21-8694-39f1c1fbd23e', 'f08ec757-7dfb-4a5c-9394-16783a5402ec', 'c97253a0-be51-48a9-b67d-377e5a8df7b6'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Delete snapshot completed successfully. Sep 07 14:05:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ccf6474e-9cd3-4c40-9960-c2f7fd55688f tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-f5eddf83-873a-497f-a0ae-3323159a33d2-delete_snapshot" released by "delete_snapshot" :: held 2.065s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "cinder-1adad61a-0a42-4b32-9872-17579f5151ea-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-039df6ea-21a1-486b-8741-b03446f36e99-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-1adad61a-0a42-4b32-9872-17579f5151ea-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-039df6ea-21a1-486b-8741-b03446f36e99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-quobyte-4dcca75f-3550-4471-b847-2fc940bdb44a" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-4dcca75f-3550-4471-b847-2fc940bdb44a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-quobyte-039df6ea-21a1-486b-8741-b03446f36e99" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "cinder-quobyte-1adad61a-0a42-4b32-9872-17579f5151ea" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-039df6ea-21a1-486b-8741-b03446f36e99" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Deleting offline snapshot 039df6ea-21a1-486b-8741-b03446f36e99 of volume 4dcca75f-3550-4471-b847-2fc940bdb44a {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] snapshot_file for this snap is: volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-quobyte-1adad61a-0a42-4b32-9872-17579f5151ea" acquired by "delete_volume" :: waited 0.039s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[baf8dcbe-b578-4714-8e87-721eea48220d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[70254317-82c1-4c2c-b01f-5f9266c38df4]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:05 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98ad40cd-65fb-4ad9-907f-ced7cb5d620d 1073741824" returned: 0 in 0.556s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98ad40cd-65fb-4ad9-907f-ced7cb5d620d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:05 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98ad40cd-65fb-4ad9-907f-ced7cb5d620d Sep 07 14:05:05 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:05 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99 Sep 07 14:05:05 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:05 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea Sep 07 14:05:05 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:05 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98ad40cd-65fb-4ad9-907f-ced7cb5d620d" returned: 0 in 0.313s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.031s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1616304488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ad9a55f-dda0-4e1c-9059-22cd5df5a35b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:03Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Creating volume 8ad9a55f-dda0-4e1c-9059-22cd5df5a35b {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:05 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:05 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99" returned: 0 in 0.435s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4dcca75f-3550-4471-b847-2fc940bdb44a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:05 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b 1073741824 Sep 07 14:05:05 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cf7c657-68a8-499b-a0bc-ba88523df875) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98ad40cd-65fb-4ad9-907f-ced7cb5d620d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa9b2a1-e339-4d19-b3a9-ce61d8a9b7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b93049d4-3a6d-4e74-9b26-1f048926233e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:05 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea" returned: 0 in 0.488s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:05 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Volume volume-98ad40cd-65fb-4ad9-907f-ced7cb5d620d (98ad40cd-65fb-4ad9-907f-ced7cb5d620d): created successfully Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fa9b2a1-e339-4d19-b3a9-ce61d8a9b7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Flow 'volume_create_manager' (b02de5e9-af2d-4228-a79f-aad659406084) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:05 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea Sep 07 14:05:05 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:05 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ae1c194f-e8be-4450-a355-c1c8ebd7d604 tempest-ProjectReaderTests-1362761481 None] Created volume successfully. Sep 07 14:05:05 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a Sep 07 14:05:05 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:05 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1adad61a-0a42-4b32-9872-17579f5151ea" returned: 0 in 0.302s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-quobyte-1adad61a-0a42-4b32-9872-17579f5151ea" released by "delete_volume" :: held 0.850s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Created reservations ['1b9b5a3e-b26e-4182-be2a-ffd51fd56ab0', '5def55bc-e858-472a-85de-3be4652ddf12', 'f74e9ddf-ca1c-4be6-8178-8b0172366147', '7e743429-233c-4718-ae50-ad211cfd2325'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:06 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:06 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b 1073741824" returned: 0 in 0.530s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a" returned: 0 in 0.453s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:06 devstack sudo[106994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99 Sep 07 14:05:06 devstack sudo[106994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:06 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:05:06 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "cinder-3525da4f-873b-4422-886d-058c51ea3cab-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:06 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b Sep 07 14:05:06 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-3525da4f-873b-4422-886d-058c51ea3cab-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "cinder-quobyte-3525da4f-873b-4422-886d-058c51ea3cab" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-quobyte-3525da4f-873b-4422-886d-058c51ea3cab" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bcb128e-2b2f-4f20-9bb4-1f84a5215b31]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3525da4f-873b-4422-886d-058c51ea3cab {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:06 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3525da4f-873b-4422-886d-058c51ea3cab Sep 07 14:05:06 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:06 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:06 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.364s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b" returned: 0 in 0.352s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Deleted volume successfully. Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5579f3b-f79b-4ebc-994f-262bd4982a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7af32b-f8c8-4197-8a92-f2f3b555d898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-077d694c-5791-44a4-8c8c-605120107a4e tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-1adad61a-0a42-4b32-9872-17579f5151ea-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:06 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Volume volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b (8ad9a55f-dda0-4e1c-9059-22cd5df5a35b): created successfully Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b7af32b-f8c8-4197-8a92-f2f3b555d898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:06 devstack sudo[106994]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (d336082c-95d0-4409-9622-1c35cc0d8018) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99" returned: 0 in 0.513s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-862ee8c6-51b6-4194-9a14-27bc20db74ee tempest-ProjectMemberTests-215815685 None] Created volume successfully. Sep 07 14:05:06 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99 Sep 07 14:05:06 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:06 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3525da4f-873b-4422-886d-058c51ea3cab" returned: 0 in 0.437s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3525da4f-873b-4422-886d-058c51ea3cab {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:06 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3525da4f-873b-4422-886d-058c51ea3cab Sep 07 14:05:06 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:06 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a.039df6ea-21a1-486b-8741-b03446f36e99" returned: 0 in 0.281s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-039df6ea-21a1-486b-8741-b03446f36e99" released by "_delete_snapshot" :: held 1.849s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-4dcca75f-3550-4471-b847-2fc940bdb44a" released by "delete_snapshot" :: held 1.888s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Acquiring lock "cinder-98ad40cd-65fb-4ad9-907f-ced7cb5d620d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Lock "cinder-98ad40cd-65fb-4ad9-907f-ced7cb5d620d-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:07 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Acquiring lock "cinder-quobyte-98ad40cd-65fb-4ad9-907f-ced7cb5d620d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-3525da4f-873b-4422-886d-058c51ea3cab" returned: 0 in 0.296s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Lock "cinder-quobyte-98ad40cd-65fb-4ad9-907f-ced7cb5d620d" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-quobyte-3525da4f-873b-4422-886d-058c51ea3cab" released by "delete_volume" :: held 0.814s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Created reservations ['81e3a46e-3073-4e6a-9b3e-24fff912e399', '4ecc4cb0-4133-4469-9a21-debcbf56106f', '386bbed5-7540-43d4-bda9-7e88fec45ff8', 'f1c231e5-c1db-4cd4-8be2-bdfcbcb2bb35'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[787bf8ae-ebe3-4da6-b2d3-71814d08ae97]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98ad40cd-65fb-4ad9-907f-ced7cb5d620d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Delete snapshot completed successfully. Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d54a773-4eab-48fd-a1ad-30f96eaabfb0 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-039df6ea-21a1-486b-8741-b03446f36e99-delete_snapshot" released by "delete_snapshot" :: held 2.184s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Created reservations ['3fbc4ab2-ff68-4ad1-8cc2-4bdc6085b066', '43df51cd-72bf-4d0a-bfd6-1d9948a866d2', '6c37a900-0e87-4b9b-a1aa-9b923ea224bf', '89910314-b2f0-435f-b101-4de02dc49023'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:07 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98ad40cd-65fb-4ad9-907f-ced7cb5d620d Sep 07 14:05:07 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:07 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:05:07 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:07 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.324s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Deleted volume successfully. Sep 07 14:05:07 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98ad40cd-65fb-4ad9-907f-ced7cb5d620d" returned: 0 in 0.510s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98ad40cd-65fb-4ad9-907f-ced7cb5d620d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8c67e4a6-32f5-4e37-a140-37724dce8c7d tempest-SnapshotDependencyTests-1435717787 None] Lock "cinder-3525da4f-873b-4422-886d-058c51ea3cab-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:07 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98ad40cd-65fb-4ad9-907f-ced7cb5d620d Sep 07 14:05:07 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:07 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-98ad40cd-65fb-4ad9-907f-ced7cb5d620d" returned: 0 in 0.335s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Lock "cinder-quobyte-98ad40cd-65fb-4ad9-907f-ced7cb5d620d" released by "delete_volume" :: held 0.915s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] Creating offline snapshot 2e6d2966-d171-4734-8107-a336a1677a49 of volume 8ad9a55f-dda0-4e1c-9059-22cd5df5a35b {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b912c0ae-c3a9-47f5-a672-a62bf22e7d5e]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Created reservations ['64967ee2-ea15-41c8-9c86-15f1c7ed0b96', '8b41be20-9397-431a-9e95-9ecc90bd670a', 'ec6c1af6-5df0-4b4c-bc55-01b66fa5b392', 'fe968884-d5c7-4df3-9fc5-36964541135f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:08 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:05:08 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:08 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b Sep 07 14:05:08 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-4dcca75f-3550-4471-b847-2fc940bdb44a-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-4dcca75f-3550-4471-b847-2fc940bdb44a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-quobyte-4dcca75f-3550-4471-b847-2fc940bdb44a" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-4dcca75f-3550-4471-b847-2fc940bdb44a" acquired by "delete_volume" :: waited 0.036s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca4fd6a-ae4b-45f3-a355-08d8e54d6d44]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:08 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.381s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Deleted volume successfully. Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09feb536-2088-40bd-8c31-d6cc1d13700a tempest-ProjectReaderTests-1362761481 None] Lock "cinder-98ad40cd-65fb-4ad9-907f-ced7cb5d620d-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:08 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a Sep 07 14:05:08 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:08 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b" returned: 0 in 0.658s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:08 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49 1G Sep 07 14:05:08 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:09 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a" returned: 0 in 0.477s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:09 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a Sep 07 14:05:09 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:09 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49 1G" returned: 0 in 0.448s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:09 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49 Sep 07 14:05:09 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:09 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-4dcca75f-3550-4471-b847-2fc940bdb44a" returned: 0 in 0.315s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-4dcca75f-3550-4471-b847-2fc940bdb44a" released by "delete_volume" :: held 0.902s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Created reservations ['57514ee3-2b89-401a-bfd0-a08a2d84412b', '92ce2031-20bd-43da-a078-7523291b3e68', 'beab6b68-4aae-4dc2-9998-f80f1ea8be38', 'fa6f805a-7b3c-4581-809a-960c3d92ab53'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:09 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49" returned: 0 in 0.420s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:09 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49 is being set with open permissions: ugo+rw Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:09 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:05:09 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:09 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49 Sep 07 14:05:09 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:09 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.273s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Deleted volume successfully. Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1f1a000a-c3c0-411b-ad91-27b994e5f057 tempest-ProjectReaderTests-1222365918 None] Lock "cinder-4dcca75f-3550-4471-b847-2fc940bdb44a-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:09 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49" returned: 0 in 0.313s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:10 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.info Sep 07 14:05:10 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:10 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.info" returned: 0 in 0.300s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:10 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.info is being set with open permissions: ugo+rw Sep 07 14:05:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:10 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.info Sep 07 14:05:10 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:10 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.info" returned: 0 in 0.281s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.566s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c3be81ab-74f8-4950-94ed-979b9f1885ee tempest-ProjectMemberTests-215815685 None] Create snapshot completed successfully Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-2e6d2966-d171-4734-8107-a336a1677a49-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Lock "cinder-2e6d2966-d171-4734-8107-a336a1677a49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-2e6d2966-d171-4734-8107-a336a1677a49" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-2e6d2966-d171-4734-8107-a336a1677a49" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Deleting offline snapshot 2e6d2966-d171-4734-8107-a336a1677a49 of volume 8ad9a55f-dda0-4e1c-9059-22cd5df5a35b {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] snapshot_file for this snap is: volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f30d17-fb22-4872-ac90-8bc6b1f15959]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Flow 'volume_create_manager' (24c78688-c747-424d-911d-831fb9013c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7f9a2d-342d-4611-8faa-f0a3daeac8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f7f9a2d-342d-4611-8faa-f0a3daeac8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-901329907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b06792c-e4c2-4926-9ee0-9d213547d31e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd700d96db2447cbc813333f921bc7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:11Z,use_quota=True,user_id='dd7d11a67cec4e66a00e7931e654a545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e1d949-99aa-4ac7-a186-2e0a57d988d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e1d949-99aa-4ac7-a186-2e0a57d988d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceec328e-5566-4868-8ee4-e323882215aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ceec328e-5566-4868-8ee4-e323882215aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b06792c-e4c2-4926-9ee0-9d213547d31e', 'volume_name': 'volume-0b06792c-e4c2-4926-9ee0-9d213547d31e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8f602e-87c0-4212-9b9e-81859fad5dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f8f602e-87c0-4212-9b9e-81859fad5dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:11 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49 Sep 07 14:05:11 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e650fbd5-4e32-42a5-b0da-07a2c40395f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:11 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Volume 0b06792c-e4c2-4926-9ee0-9d213547d31e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b06792c-e4c2-4926-9ee0-9d213547d31e', 'volume_size': 1} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-901329907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b06792c-e4c2-4926-9ee0-9d213547d31e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd700d96db2447cbc813333f921bc7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:11Z,use_quota=True,user_id='dd7d11a67cec4e66a00e7931e654a545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Creating volume 0b06792c-e4c2-4926-9ee0-9d213547d31e {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:11 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:11 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e 1073741824 Sep 07 14:05:11 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:11 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49" returned: 0 in 0.478s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c295c3-82c1-41a3-a88b-d2358d7260d5]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:12 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b Sep 07 14:05:12 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:12 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e 1073741824" returned: 0 in 0.638s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:12 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e Sep 07 14:05:12 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:12 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b" returned: 0 in 0.501s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:12 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49 Sep 07 14:05:12 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:12 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e" returned: 0 in 0.308s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e650fbd5-4e32-42a5-b0da-07a2c40395f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b06792c-e4c2-4926-9ee0-9d213547d31e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed489e27-7627-4f95-a0e2-99cd1459e0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:12 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Volume volume-0b06792c-e4c2-4926-9ee0-9d213547d31e (0b06792c-e4c2-4926-9ee0-9d213547d31e): created successfully Sep 07 14:05:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed489e27-7627-4f95-a0e2-99cd1459e0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Flow 'volume_create_manager' (24c78688-c747-424d-911d-831fb9013c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7fb47af5-8151-4a1d-ab04-5b65d9e033bb tempest-ProjectReaderTests-1222365918 None] Created volume successfully. Sep 07 14:05:12 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49" returned: 0 in 0.385s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:12 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49 Sep 07 14:05:12 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:12 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b.2e6d2966-d171-4734-8107-a336a1677a49" returned: 0 in 0.285s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-2e6d2966-d171-4734-8107-a336a1677a49" released by "_delete_snapshot" :: held 1.773s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b" released by "delete_snapshot" :: held 1.809s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Created reservations ['80960883-b86d-4852-bd99-a3f983715ce6', '88cbd2f9-3924-4734-861a-dd3659156805', 'a91ad611-3dda-4168-ad94-b528405115ae', '450c09db-aab3-4423-b4db-8af661372701'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:13 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Delete snapshot completed successfully. Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f83a0b54-a9e5-455a-a83b-da4402a6429d tempest-ProjectMemberTests-215815685 None] Lock "cinder-2e6d2966-d171-4734-8107-a336a1677a49-delete_snapshot" released by "delete_snapshot" :: held 1.952s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Lock "cinder-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3116e737-64c0-4105-9b26-93413440ae2f]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] Creating offline snapshot d6ee0c3e-7e3b-4422-bbd2-45dc205d15be of volume 0b06792c-e4c2-4926-9ee0-9d213547d31e {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1dc53bb-e788-491f-ba5f-9f467ff789ff]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:13 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b Sep 07 14:05:13 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:13 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e Sep 07 14:05:13 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:13 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b" returned: 0 in 0.421s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:14 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b Sep 07 14:05:14 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:14 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e" returned: 0 in 0.427s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:14 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be 1G Sep 07 14:05:14 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:14 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b" returned: 0 in 0.281s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b" released by "delete_volume" :: held 0.789s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Created reservations ['0756c5a6-7e01-4bb5-980d-68ada172f157', 'c6c390ea-ecfa-41a0-a04d-47b133b512d1', '27772ba9-780f-4de4-9a2f-08f6d4b11ba9', '311a3ccc-3bed-4cb4-971f-6859c38db1f4'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:14 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:05:14 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:14 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be 1G" returned: 0 in 0.464s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b06792c-e4c2-4926-9ee0-9d213547d31e -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:14 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b06792c-e4c2-4926-9ee0-9d213547d31e -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be Sep 07 14:05:14 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:14 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.324s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Deleted volume successfully. Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-59ae5f53-cf81-4eaa-926a-8a499f1c8182 tempest-ProjectMemberTests-215815685 None] Lock "cinder-8ad9a55f-dda0-4e1c-9059-22cd5df5a35b-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:14 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b06792c-e4c2-4926-9ee0-9d213547d31e -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be" returned: 0 in 0.455s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:14 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be is being set with open permissions: ugo+rw Sep 07 14:05:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:15 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be Sep 07 14:05:15 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (ec444707-30b4-4e07-8c6c-f548d29302e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1d7f4a-505d-4bd4-9c0f-cb58d0c36cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb1d7f4a-505d-4bd4-9c0f-cb58d0c36cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1525417188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=addbc4cf-a5ab-4576-91b1-fba5ee96e356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:15Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfd90e4-eb7a-4c67-adb7-4c1d4405ba48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adfd90e4-eb7a-4c67-adb7-4c1d4405ba48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (591d4117-9411-412a-ae25-553e9b7d2cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:15 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (591d4117-9411-412a-ae25-553e9b7d2cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'addbc4cf-a5ab-4576-91b1-fba5ee96e356', 'volume_name': 'volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d3044e-276e-4fdd-b9d9-b0c0a3eb91ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0d3044e-276e-4fdd-b9d9-b0c0a3eb91ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f6045b-bd9a-4395-8177-8ae08d44f045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:15 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Volume addbc4cf-a5ab-4576-91b1-fba5ee96e356: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356', 'volume_size': 1} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be" returned: 0 in 0.290s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:15 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.info Sep 07 14:05:15 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:15 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.info" returned: 0 in 0.277s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:15 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.info is being set with open permissions: ugo+rw Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:15 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.info Sep 07 14:05:15 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:15 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.info" returned: 0 in 0.246s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.260s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.590s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1525417188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=addbc4cf-a5ab-4576-91b1-fba5ee96e356,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:15Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Creating volume addbc4cf-a5ab-4576-91b1-fba5ee96e356 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:15 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:05:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:15 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 1073741824 Sep 07 14:05:15 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:15 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5b4cafdf-9747-4281-b699-262da27e06c1 tempest-ProjectReaderTests-1222365918 None] Create snapshot completed successfully Sep 07 14:05:16 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 1073741824" returned: 0 in 0.407s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:16 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 Sep 07 14:05:16 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:16 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356" returned: 0 in 0.254s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10f6045b-bd9a-4395-8177-8ae08d44f045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6f923e-4943-47fc-97bc-bbac4e1c19ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:16 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Volume volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 (addbc4cf-a5ab-4576-91b1-fba5ee96e356): created successfully Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a6f923e-4943-47fc-97bc-bbac4e1c19ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (ec444707-30b4-4e07-8c6c-f548d29302e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:16 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c51422a2-eb9c-4d65-8c47-c46dab2ae3d6 tempest-ProjectMemberTests-215815685 None] Created volume successfully. Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-d6ee0c3e-7e3b-4422-bbd2-45dc205d15be-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Lock "cinder-d6ee0c3e-7e3b-4422-bbd2-45dc205d15be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-quobyte-0b06792c-e4c2-4926-9ee0-9d213547d31e" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-0b06792c-e4c2-4926-9ee0-9d213547d31e" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-quobyte-d6ee0c3e-7e3b-4422-bbd2-45dc205d15be" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-d6ee0c3e-7e3b-4422-bbd2-45dc205d15be" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Deleting offline snapshot d6ee0c3e-7e3b-4422-bbd2-45dc205d15be of volume 0b06792c-e4c2-4926-9ee0-9d213547d31e {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] snapshot_file for this snap is: volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6f93ea-e2aa-43e9-b0aa-9411cc676388]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:17 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be Sep 07 14:05:17 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:17 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be" returned: 0 in 0.415s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b06792c-e4c2-4926-9ee0-9d213547d31e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:17 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[beca158a-d885-4423-8a03-334e107eac73]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] Creating offline snapshot 6578a4c3-abac-44ee-92ad-089a0b18cb85 of volume addbc4cf-a5ab-4576-91b1-fba5ee96e356 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:17 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[563a88a1-1db4-419b-b930-59173ced26bb]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:17 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e Sep 07 14:05:17 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:17 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 Sep 07 14:05:17 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:17 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e" returned: 0 in 0.491s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:17 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be Sep 07 14:05:17 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:18 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356" returned: 0 in 0.511s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:18 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85 1G Sep 07 14:05:18 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:18 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be" returned: 0 in 0.421s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:18 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be Sep 07 14:05:18 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:18 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85 1G" returned: 0 in 0.509s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:18 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85 Sep 07 14:05:18 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:18 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e.d6ee0c3e-7e3b-4422-bbd2-45dc205d15be" returned: 0 in 0.289s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-d6ee0c3e-7e3b-4422-bbd2-45dc205d15be" released by "_delete_snapshot" :: held 1.798s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-0b06792c-e4c2-4926-9ee0-9d213547d31e" released by "delete_snapshot" :: held 1.840s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:18 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Created reservations ['d4e06717-5edb-4875-8990-1e0e5b0c3625', '7080cca5-78d6-440a-9fec-4af3f58de652', 'cfff4755-0040-4a76-853c-293c279befb2', 'd450233e-9e50-40e0-9237-c7354ba0ba68'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Delete snapshot completed successfully. Sep 07 14:05:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-734470dd-39fe-4b5b-8af0-d791d0ad177f tempest-ProjectReaderTests-1222365918 None] Lock "cinder-d6ee0c3e-7e3b-4422-bbd2-45dc205d15be-delete_snapshot" released by "delete_snapshot" :: held 2.026s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:18 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85" returned: 0 in 0.395s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:18 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85 is being set with open permissions: ugo+rw Sep 07 14:05:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:18 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85 Sep 07 14:05:18 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-0b06792c-e4c2-4926-9ee0-9d213547d31e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Lock "cinder-0b06792c-e4c2-4926-9ee0-9d213547d31e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-quobyte-0b06792c-e4c2-4926-9ee0-9d213547d31e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-0b06792c-e4c2-4926-9ee0-9d213547d31e" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:19 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[09021550-9b36-4656-8b9b-bd6028016a63]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:19 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85" returned: 0 in 0.323s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:19 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e Sep 07 14:05:19 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:19 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.info Sep 07 14:05:19 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:19 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e" returned: 0 in 0.427s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:19 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.info" returned: 0 in 0.329s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:19 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.info is being set with open permissions: ugo+rw Sep 07 14:05:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:19 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e Sep 07 14:05:19 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:19 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.info Sep 07 14:05:19 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:19 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-0b06792c-e4c2-4926-9ee0-9d213547d31e" returned: 0 in 0.309s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-0b06792c-e4c2-4926-9ee0-9d213547d31e" released by "delete_volume" :: held 0.812s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:19 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.info" returned: 0 in 0.321s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.495s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:19 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-772f03a0-00cc-481c-9ac9-bc577160b27c tempest-ProjectMemberTests-215815685 None] Create snapshot completed successfully Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Created reservations ['b8dc318c-28a3-45f4-8e01-cf8d872c62d7', 'd098785c-4f1d-4256-b124-77c422959a1c', '577216c6-afb5-4f59-9275-8e781f396a3f', '0dfd217e-a22c-45cb-bc4a-be320faa9d68'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:20 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:05:20 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:20 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.274s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Deleted volume successfully. Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1dd0c301-4f62-4ba4-99d9-8d102274afab tempest-ProjectReaderTests-1222365918 None] Lock "cinder-0b06792c-e4c2-4926-9ee0-9d213547d31e-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-6578a4c3-abac-44ee-92ad-089a0b18cb85-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Lock "cinder-6578a4c3-abac-44ee-92ad-089a0b18cb85-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-addbc4cf-a5ab-4576-91b1-fba5ee96e356" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-addbc4cf-a5ab-4576-91b1-fba5ee96e356" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-6578a4c3-abac-44ee-92ad-089a0b18cb85" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-6578a4c3-abac-44ee-92ad-089a0b18cb85" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Deleting offline snapshot 6578a4c3-abac-44ee-92ad-089a0b18cb85 of volume addbc4cf-a5ab-4576-91b1-fba5ee96e356 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] snapshot_file for this snap is: volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bea7a4-7313-4a6e-b23a-842a69f52017]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Flow 'volume_create_manager' (66366114-8e97-44eb-9cb8-3b4c91ffb6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01437b49-2090-4cd7-b6c1-7e117ba22a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01437b49-2090-4cd7-b6c1-7e117ba22a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285414946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4713878-f3e6-4911-9947-7d48336b9165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd700d96db2447cbc813333f921bc7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:21Z,use_quota=True,user_id='dd7d11a67cec4e66a00e7931e654a545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd26a59e-18df-4611-8c0b-436e110542d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd26a59e-18df-4611-8c0b-436e110542d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb39ef3f-4f50-4d70-90bb-2e02ba3ae13a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb39ef3f-4f50-4d70-90bb-2e02ba3ae13a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4713878-f3e6-4911-9947-7d48336b9165', 'volume_name': 'volume-d4713878-f3e6-4911-9947-7d48336b9165', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39efb48-8a76-42f0-bf16-094dd6e0dbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a39efb48-8a76-42f0-bf16-094dd6e0dbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67e7aa2-f827-44a0-b949-6e271a36bd86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:20 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Volume d4713878-f3e6-4911-9947-7d48336b9165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4713878-f3e6-4911-9947-7d48336b9165', 'volume_size': 1} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-285414946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4713878-f3e6-4911-9947-7d48336b9165,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cd700d96db2447cbc813333f921bc7f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:21Z,use_quota=True,user_id='dd7d11a67cec4e66a00e7931e654a545',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Creating volume d4713878-f3e6-4911-9947-7d48336b9165 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:20 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85 Sep 07 14:05:20 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:20 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:05:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:20 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165 1073741824 Sep 07 14:05:20 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:21 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85" returned: 0 in 0.369s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d621e84-be8a-4e0f-90e2-f80a5b3ea539]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:21 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 Sep 07 14:05:21 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:21 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165 1073741824" returned: 0 in 0.440s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:21 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165 Sep 07 14:05:21 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:21 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356" returned: 0 in 0.412s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:21 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85 Sep 07 14:05:21 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:21 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165" returned: 0 in 0.274s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e67e7aa2-f827-44a0-b949-6e271a36bd86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4713878-f3e6-4911-9947-7d48336b9165', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0b717a-befa-4eec-ac18-ac2fa88fafa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:21 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Volume volume-d4713878-f3e6-4911-9947-7d48336b9165 (d4713878-f3e6-4911-9947-7d48336b9165): created successfully Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a0b717a-befa-4eec-ac18-ac2fa88fafa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Flow 'volume_create_manager' (66366114-8e97-44eb-9cb8-3b4c91ffb6fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-bd0bc8e5-0f98-4709-a7ea-0cac1d694afe tempest-ProjectReaderTests-1222365918 None] Created volume successfully. Sep 07 14:05:21 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85" returned: 0 in 0.353s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:21 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85 Sep 07 14:05:21 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:22 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356.6578a4c3-abac-44ee-92ad-089a0b18cb85" returned: 0 in 0.244s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-6578a4c3-abac-44ee-92ad-089a0b18cb85" released by "_delete_snapshot" :: held 1.487s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-addbc4cf-a5ab-4576-91b1-fba5ee96e356" released by "delete_snapshot" :: held 1.513s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:22 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Created reservations ['d858843c-1302-4e78-96bf-f3cbce336194', '440b0285-d80d-4f8c-ba41-ef40c4eb42cb', '9a54688f-5a5c-45f2-8058-882a075253cc', '309ff74b-5da9-42cf-ba16-9c9804dffa62'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Delete snapshot completed successfully. Sep 07 14:05:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b75f8ff2-99ba-4472-8752-d3e7ae7b31ec tempest-ProjectMemberTests-215815685 None] Lock "cinder-6578a4c3-abac-44ee-92ad-089a0b18cb85-delete_snapshot" released by "delete_snapshot" :: held 1.647s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-addbc4cf-a5ab-4576-91b1-fba5ee96e356-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Lock "cinder-addbc4cf-a5ab-4576-91b1-fba5ee96e356-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-addbc4cf-a5ab-4576-91b1-fba5ee96e356" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-addbc4cf-a5ab-4576-91b1-fba5ee96e356" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e20470a4-321b-4213-a963-f2beee68bb78]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] Creating offline snapshot 038568aa-1d7f-45de-a1d6-52298a79f924 of volume d4713878-f3e6-4911-9947-7d48336b9165 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0864fb-3c3b-4db9-b3c8-16f2059ae991]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:23 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 Sep 07 14:05:23 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:23 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165 Sep 07 14:05:23 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:23 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356" returned: 0 in 0.380s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:23 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356 Sep 07 14:05:23 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:23 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165" returned: 0 in 0.377s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:23 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924 1G Sep 07 14:05:23 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:23 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-addbc4cf-a5ab-4576-91b1-fba5ee96e356" returned: 0 in 0.269s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-addbc4cf-a5ab-4576-91b1-fba5ee96e356" released by "delete_volume" :: held 0.728s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:23 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Created reservations ['66dd2847-c34c-475e-8cd9-a258c12e772c', '311bdd3d-3f7f-49ed-b414-cd182da03b9a', 'd110503b-1f9a-4a50-b64d-4f55b2f6e8d9', 'c303cad9-1ad8-4139-9b3a-2267cf6c47f6'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:23 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:05:23 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:24 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924 1G" returned: 0 in 0.594s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4713878-f3e6-4911-9947-7d48336b9165 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:24 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4713878-f3e6-4911-9947-7d48336b9165 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924 Sep 07 14:05:24 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:24 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.308s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Deleted volume successfully. Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f635df69-d8bc-4910-9bed-d498bb38b985 tempest-ProjectMemberTests-215815685 None] Lock "cinder-addbc4cf-a5ab-4576-91b1-fba5ee96e356-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:24 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4713878-f3e6-4911-9947-7d48336b9165 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924" returned: 0 in 0.308s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:24 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924 is being set with open permissions: ugo+rw Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:24 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924 Sep 07 14:05:24 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (5490948b-bac9-4cb0-8c80-43542ca12f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7dac89b-d94d-4c27-a17e-f015509cb1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7dac89b-d94d-4c27-a17e-f015509cb1d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-694660481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024231ea-96bf-4f35-be25-b7615534da73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:24Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365b7ec2-d1fa-4c0f-8236-89e950d3ebab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365b7ec2-d1fa-4c0f-8236-89e950d3ebab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:24 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35e4d05-3006-48d1-8745-554270702bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35e4d05-3006-48d1-8745-554270702bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '024231ea-96bf-4f35-be25-b7615534da73', 'volume_name': 'volume-024231ea-96bf-4f35-be25-b7615534da73', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4246c3-3133-47a9-a136-ca3112946eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e4246c3-3133-47a9-a136-ca3112946eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8d0751-941e-461e-bc6d-c7ea62523a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:24 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Volume 024231ea-96bf-4f35-be25-b7615534da73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-024231ea-96bf-4f35-be25-b7615534da73', 'volume_size': 1} Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924" returned: 0 in 0.314s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:24 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.info Sep 07 14:05:24 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:24 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.info" returned: 0 in 0.274s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:24 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.info is being set with open permissions: ugo+rw Sep 07 14:05:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:24 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.info Sep 07 14:05:24 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:25 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.info" returned: 0 in 0.245s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.201s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-694660481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=024231ea-96bf-4f35-be25-b7615534da73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:24Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Creating volume 024231ea-96bf-4f35-be25-b7615534da73 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:25 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:25 devstack sudo[107265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73 1073741824 Sep 07 14:05:25 devstack sudo[107265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c9c27e2e-dc2f-4963-85a4-9802b0ff2b6b tempest-ProjectReaderTests-1222365918 None] Create snapshot completed successfully Sep 07 14:05:25 devstack sudo[107265]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73 1073741824" returned: 0 in 0.432s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:25 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73 Sep 07 14:05:25 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:25 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73" returned: 0 in 0.268s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef8d0751-941e-461e-bc6d-c7ea62523a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-024231ea-96bf-4f35-be25-b7615534da73', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec9f3d8-9b14-488a-abf1-49e148dd574a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:25 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Volume volume-024231ea-96bf-4f35-be25-b7615534da73 (024231ea-96bf-4f35-be25-b7615534da73): created successfully Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ec9f3d8-9b14-488a-abf1-49e148dd574a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (5490948b-bac9-4cb0-8c80-43542ca12f6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9b2e1697-20c0-4572-9278-29f4004d5509 tempest-ProjectMemberTests-215815685 None] Created volume successfully. Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-038568aa-1d7f-45de-a1d6-52298a79f924-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Lock "cinder-038568aa-1d7f-45de-a1d6-52298a79f924-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-quobyte-d4713878-f3e6-4911-9947-7d48336b9165" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-d4713878-f3e6-4911-9947-7d48336b9165" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-quobyte-038568aa-1d7f-45de-a1d6-52298a79f924" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-038568aa-1d7f-45de-a1d6-52298a79f924" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Deleting offline snapshot 038568aa-1d7f-45de-a1d6-52298a79f924 of volume d4713878-f3e6-4911-9947-7d48336b9165 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] snapshot_file for this snap is: volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[af183bfa-e61d-46bd-9815-07c5e8927160]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:26 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924 Sep 07 14:05:26 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:26 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924" returned: 0 in 0.382s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4713878-f3e6-4911-9947-7d48336b9165(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fab1504-0753-4225-abbf-1ecfaf94515c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] Creating offline snapshot 03cafde9-cb7e-4b5e-bcc1-02e559118afe of volume 024231ea-96bf-4f35-be25-b7615534da73 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:26 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165 Sep 07 14:05:26 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9c44b72-2a87-4c33-9cc3-198033e52df9]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:26 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73 Sep 07 14:05:26 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:27 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165" returned: 0 in 0.399s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:27 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924 Sep 07 14:05:27 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:27 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73" returned: 0 in 0.390s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:27 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe 1G Sep 07 14:05:27 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:27 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924" returned: 0 in 0.340s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:27 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924 Sep 07 14:05:27 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:27 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe 1G" returned: 0 in 0.430s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-024231ea-96bf-4f35-be25-b7615534da73 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:27 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165.038568aa-1d7f-45de-a1d6-52298a79f924" returned: 0 in 0.255s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:27 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-024231ea-96bf-4f35-be25-b7615534da73 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe Sep 07 14:05:27 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-038568aa-1d7f-45de-a1d6-52298a79f924" released by "_delete_snapshot" :: held 1.480s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-d4713878-f3e6-4911-9947-7d48336b9165" released by "delete_snapshot" :: held 1.506s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:27 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Created reservations ['3cd8021b-bd3d-4431-bc95-7c51bb72dee6', '4660d3c9-f857-4249-bea6-bc3f6a543548', 'e3d5e2fb-560d-4e30-bd9d-247e0ffd0512', '6da69f2c-ef8f-401f-9383-b76769773d50'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:27 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Delete snapshot completed successfully. Sep 07 14:05:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a7920449-b6a1-4c1d-98c7-bdc709a604fc tempest-ProjectReaderTests-1222365918 None] Lock "cinder-038568aa-1d7f-45de-a1d6-52298a79f924-delete_snapshot" released by "delete_snapshot" :: held 1.680s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:27 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-024231ea-96bf-4f35-be25-b7615534da73 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe" returned: 0 in 0.302s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:27 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe is being set with open permissions: ugo+rw Sep 07 14:05:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:27 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe Sep 07 14:05:27 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:28 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe" returned: 0 in 0.234s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:28 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.info Sep 07 14:05:28 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-d4713878-f3e6-4911-9947-7d48336b9165-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Lock "cinder-d4713878-f3e6-4911-9947-7d48336b9165-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Acquiring lock "cinder-quobyte-d4713878-f3e6-4911-9947-7d48336b9165" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-d4713878-f3e6-4911-9947-7d48336b9165" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:28 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70a61ea-a4ca-4112-8e11-7c2cba6bd8b2]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.info" returned: 0 in 0.304s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:28 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.info is being set with open permissions: ugo+rw Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:28 devstack sudo[107313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.info Sep 07 14:05:28 devstack sudo[107313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:28 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165 Sep 07 14:05:28 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:28 devstack sudo[107313]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.info" returned: 0 in 0.269s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ecbd2249-fcd1-49d6-90ec-cd8583be5bfd tempest-ProjectMemberTests-215815685 None] Create snapshot completed successfully Sep 07 14:05:28 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165" returned: 0 in 0.394s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:28 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165 Sep 07 14:05:28 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-03cafde9-cb7e-4b5e-bcc1-02e559118afe-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Lock "cinder-03cafde9-cb7e-4b5e-bcc1-02e559118afe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-024231ea-96bf-4f35-be25-b7615534da73" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-024231ea-96bf-4f35-be25-b7615534da73" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-03cafde9-cb7e-4b5e-bcc1-02e559118afe" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-03cafde9-cb7e-4b5e-bcc1-02e559118afe" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Deleting offline snapshot 03cafde9-cb7e-4b5e-bcc1-02e559118afe of volume 024231ea-96bf-4f35-be25-b7615534da73 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] snapshot_file for this snap is: volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84f9322-e529-4435-b52a-da75600db039]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:29 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-d4713878-f3e6-4911-9947-7d48336b9165" returned: 0 in 0.270s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:29 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe Sep 07 14:05:29 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Lock "cinder-quobyte-d4713878-f3e6-4911-9947-7d48336b9165" released by "delete_volume" :: held 0.730s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Created reservations ['ea064ebc-d71e-4193-ad10-76ab331e3f27', 'd071f010-f611-4204-b289-6ab9df6b84ad', '6d4ccdd9-2064-4ed3-892d-94099e43b9a1', 'ff11a6e2-e773-4029-abcd-78e4084c81c5'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:29 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:05:29 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:29 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe" returned: 0 in 0.406s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-024231ea-96bf-4f35-be25-b7615534da73(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc227b7-2da0-423f-bfb7-5b938cecdea6]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:29 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.281s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Deleted volume successfully. Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2a175cc1-d073-4a9e-b82a-97c2c19ac59c tempest-ProjectReaderTests-1222365918 None] Lock "cinder-d4713878-f3e6-4911-9947-7d48336b9165-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:29 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73 Sep 07 14:05:29 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:29 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73" returned: 0 in 0.403s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:29 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:05:29 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:29 devstack sudo[107337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe Sep 07 14:05:29 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:30 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.312s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:05:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 29 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 14:05:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 07 14:05:30 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe" returned: 0 in 0.387s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:30 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe Sep 07 14:05:30 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:30 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73.03cafde9-cb7e-4b5e-bcc1-02e559118afe" returned: 0 in 0.288s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-03cafde9-cb7e-4b5e-bcc1-02e559118afe" released by "_delete_snapshot" :: held 1.606s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-024231ea-96bf-4f35-be25-b7615534da73" released by "delete_snapshot" :: held 1.631s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:30 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Created reservations ['d00d16c9-be49-48d1-82e1-7d32811dee4d', 'a0af0d90-c60b-4142-ab92-d1e4fc63fd0a', '792f650d-fe9f-4105-b968-ced839eb6879', '2cccaacc-8ddd-4629-bf88-652b2ec292fd'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:30 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Delete snapshot completed successfully. Sep 07 14:05:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2c30d0d1-26be-4387-ac31-de50598d459c tempest-ProjectMemberTests-215815685 None] Lock "cinder-03cafde9-cb7e-4b5e-bcc1-02e559118afe-delete_snapshot" released by "delete_snapshot" :: held 1.788s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-024231ea-96bf-4f35-be25-b7615534da73-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Lock "cinder-024231ea-96bf-4f35-be25-b7615534da73-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-024231ea-96bf-4f35-be25-b7615534da73" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-024231ea-96bf-4f35-be25-b7615534da73" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:31 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[89307723-2a6b-411c-80a4-83f6fe7e8e06]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:31 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73 Sep 07 14:05:31 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:31 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73" returned: 0 in 0.381s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:31 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73 Sep 07 14:05:31 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:31 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-024231ea-96bf-4f35-be25-b7615534da73" returned: 0 in 0.277s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-024231ea-96bf-4f35-be25-b7615534da73" released by "delete_volume" :: held 0.722s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Created reservations ['f443a6fb-213d-4662-8e36-05881c7f0015', 'be3e748d-8c41-4de4-98ef-286e012db860', '6e8aef09-a66f-4cf9-89df-53b3b4ff658f', '87863c83-1568-42a3-9daa-5941ce549e84'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:32 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:05:32 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:32 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.274s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:32 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Deleted volume successfully. Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7e125270-efe6-4564-96c0-cbdf85306f64 tempest-ProjectMemberTests-215815685 None] Lock "cinder-024231ea-96bf-4f35-be25-b7615534da73-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (448ceb50-9dc5-44e7-9580-2bedf727c822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c604a1a8-25bc-47d7-9749-0ea483498dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c604a1a8-25bc-47d7-9749-0ea483498dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1576790161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=904a78e5-39fc-408e-86e2-074a90f83d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:33Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618422c2-1df2-414a-a306-7a5beaee948e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (618422c2-1df2-414a-a306-7a5beaee948e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55050112-d64f-48a6-9c35-6570bc64e194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55050112-d64f-48a6-9c35-6570bc64e194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '904a78e5-39fc-408e-86e2-074a90f83d6a', 'volume_name': 'volume-904a78e5-39fc-408e-86e2-074a90f83d6a', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6becf4c-6d0b-4b2c-84a1-69450906c479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6becf4c-6d0b-4b2c-84a1-69450906c479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23b00fb-2bb1-42ba-9239-ed24547e9028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:32 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Volume 904a78e5-39fc-408e-86e2-074a90f83d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-904a78e5-39fc-408e-86e2-074a90f83d6a', 'volume_size': 1} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1576790161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=904a78e5-39fc-408e-86e2-074a90f83d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:33Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Creating volume 904a78e5-39fc-408e-86e2-074a90f83d6a {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:32 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:05:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:32 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a 1073741824 Sep 07 14:05:32 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:33 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a 1073741824" returned: 0 in 0.440s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:33 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a Sep 07 14:05:33 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:33 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a" returned: 0 in 0.254s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e23b00fb-2bb1-42ba-9239-ed24547e9028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-904a78e5-39fc-408e-86e2-074a90f83d6a', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869f3ec3-4a62-489d-8e4a-f7dcd915eaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:33 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Volume volume-904a78e5-39fc-408e-86e2-074a90f83d6a (904a78e5-39fc-408e-86e2-074a90f83d6a): created successfully Sep 07 14:05:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (869f3ec3-4a62-489d-8e4a-f7dcd915eaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (448ceb50-9dc5-44e7-9580-2bedf727c822) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-166e9325-3ee0-4bd6-b1c5-48ed69d22e2e tempest-ProjectMemberTests-215815685 None] Created volume successfully. Sep 07 14:05:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] Creating offline snapshot 0291b7f7-4efd-498c-953c-6a5f9cba78bb of volume 904a78e5-39fc-408e-86e2-074a90f83d6a {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:34 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[83126c71-96e1-40ce-860e-20b22bd8f060]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:34 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a Sep 07 14:05:34 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:34 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a" returned: 0 in 0.408s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:34 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb 1G Sep 07 14:05:34 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:34 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb 1G" returned: 0 in 0.428s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-904a78e5-39fc-408e-86e2-074a90f83d6a -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:34 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-904a78e5-39fc-408e-86e2-074a90f83d6a -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb Sep 07 14:05:34 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:35 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-904a78e5-39fc-408e-86e2-074a90f83d6a -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb" returned: 0 in 0.286s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:35 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb is being set with open permissions: ugo+rw Sep 07 14:05:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:35 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb Sep 07 14:05:35 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:35 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb" returned: 0 in 0.259s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:35 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.info Sep 07 14:05:35 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:35 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.info" returned: 0 in 0.249s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:35 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.info is being set with open permissions: ugo+rw Sep 07 14:05:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:35 devstack sudo[107391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.info Sep 07 14:05:35 devstack sudo[107391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:35 devstack sudo[107391]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.info" returned: 0 in 0.253s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.975s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:35 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6d8c8b06-49d9-43a1-9b1b-72e2d92ed352 tempest-ProjectMemberTests-215815685 None] Create snapshot completed successfully Sep 07 14:05:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-0291b7f7-4efd-498c-953c-6a5f9cba78bb-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Lock "cinder-0291b7f7-4efd-498c-953c-6a5f9cba78bb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-904a78e5-39fc-408e-86e2-074a90f83d6a" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-904a78e5-39fc-408e-86e2-074a90f83d6a" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-0291b7f7-4efd-498c-953c-6a5f9cba78bb" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-0291b7f7-4efd-498c-953c-6a5f9cba78bb" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Deleting offline snapshot 0291b7f7-4efd-498c-953c-6a5f9cba78bb of volume 904a78e5-39fc-408e-86e2-074a90f83d6a {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] snapshot_file for this snap is: volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:36 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ce3e27-80fb-4984-9421-a391c9cd24d9]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:36 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb Sep 07 14:05:36 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:36 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb" returned: 0 in 0.384s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-904a78e5-39fc-408e-86e2-074a90f83d6a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:36 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[621c25ef-dd14-49fd-ab40-2ec4b149cacc]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:36 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a Sep 07 14:05:36 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:37 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a" returned: 0 in 0.380s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:37 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb Sep 07 14:05:37 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:37 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb" returned: 0 in 0.362s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:37 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb Sep 07 14:05:37 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:37 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a.0291b7f7-4efd-498c-953c-6a5f9cba78bb" returned: 0 in 0.260s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-0291b7f7-4efd-498c-953c-6a5f9cba78bb" released by "_delete_snapshot" :: held 1.493s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-904a78e5-39fc-408e-86e2-074a90f83d6a" released by "delete_snapshot" :: held 1.521s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:37 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Created reservations ['81aba0dd-3bcb-4348-abe0-25a329058f3e', '5eaab85b-3546-477c-ae51-66a12cc78db5', '705dd7a9-d8db-4b94-8e20-da41bce7a49d', '10f1a526-c678-4fe6-b12c-c0df7e954c57'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Delete snapshot completed successfully. Sep 07 14:05:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc95c495-31f8-4c9d-950e-79b7774559a3 tempest-ProjectMemberTests-215815685 None] Lock "cinder-0291b7f7-4efd-498c-953c-6a5f9cba78bb-delete_snapshot" released by "delete_snapshot" :: held 1.682s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-904a78e5-39fc-408e-86e2-074a90f83d6a-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Lock "cinder-904a78e5-39fc-408e-86e2-074a90f83d6a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:38 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=191,cinder:INSERT=69,cinder:UPDATE=240,cinder:DELETE=24 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:05:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-904a78e5-39fc-408e-86e2-074a90f83d6a" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-904a78e5-39fc-408e-86e2-074a90f83d6a" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:38 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f129cc3-73b9-495d-a33a-944fa8c5e7b6]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:38 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a Sep 07 14:05:38 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:38 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a" returned: 0 in 0.384s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:38 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a Sep 07 14:05:38 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:39 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-904a78e5-39fc-408e-86e2-074a90f83d6a" returned: 0 in 0.289s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-904a78e5-39fc-408e-86e2-074a90f83d6a" released by "delete_volume" :: held 0.740s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:39 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:INSERT=62,cinder:UPDATE=254,cinder:SELECT=184,cinder:DELETE=16 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:05:39 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Created reservations ['045a1ae7-70f9-4806-a3f1-2518573437e3', '39e798db-41d7-44cf-8a39-f6010ff978cc', 'd68a9b2c-6396-4b2b-ac47-ee5ade3d8be2', 'c22da402-d54a-4e7d-99c9-ea5a93d16978'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:39 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:05:39 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:39 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.276s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:39 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:39 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Deleted volume successfully. Sep 07 14:05:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c0e8f03-e40a-4f63-bec2-e46f0ca4ff9f tempest-ProjectMemberTests-215815685 None] Lock "cinder-904a78e5-39fc-408e-86e2-074a90f83d6a-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (482a29b7-fc1d-4cf4-ad5b-2c91b46e5e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13739c7a-650a-4a85-95a8-334b207d0772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13739c7a-650a-4a85-95a8-334b207d0772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-200326051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24a3f38-5312-4d1e-8391-2f16b0db27b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:40Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3059813a-1020-4d88-b2a2-d42953aa8ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3059813a-1020-4d88-b2a2-d42953aa8ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31be464-d30e-41c8-93ab-dfd6fc9421d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31be464-d30e-41c8-93ab-dfd6fc9421d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24a3f38-5312-4d1e-8391-2f16b0db27b4', 'volume_name': 'volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13960e56-6fd6-4100-aaf5-b8309f54821f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13960e56-6fd6-4100-aaf5-b8309f54821f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c53d23-2cb8-4bb4-9704-eaeb50fb219b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:40 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Volume c24a3f38-5312-4d1e-8391-2f16b0db27b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4', 'volume_size': 1} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-200326051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24a3f38-5312-4d1e-8391-2f16b0db27b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:40Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Creating volume c24a3f38-5312-4d1e-8391-2f16b0db27b4 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:40 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:40 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 1073741824 Sep 07 14:05:40 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:40 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 1073741824" returned: 0 in 0.477s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:40 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 Sep 07 14:05:40 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:40 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4" returned: 0 in 0.287s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] <== create_volume: return (819ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.823s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8c53d23-2cb8-4bb4-9704-eaeb50fb219b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569cda5c-7262-410e-9dbe-71855a2b757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:41 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Volume volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 (c24a3f38-5312-4d1e-8391-2f16b0db27b4): created successfully Sep 07 14:05:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (569cda5c-7262-410e-9dbe-71855a2b757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (482a29b7-fc1d-4cf4-ad5b-2c91b46e5e44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:41 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8210ace9-4321-4221-bda0-1c81b2cd6369 tempest-ProjectMemberTests-215815685 None] Created volume successfully. Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Flow 'volume_create_manager' (5a0cec4f-88a3-46f0-b19f-55aa369ecef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4921443d-f6b3-4c46-8adb-a5507bed855e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4921443d-f6b3-4c46-8adb-a5507bed855e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511915522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54344661-c137-4bbc-9913-091c8b6ff6fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='837e7274ed9c44a99d2dc6e5a529cfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:42Z,use_quota=True,user_id='c240e04b9b524f17b258e50fd239b3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de7cf87-b7c8-4787-b529-9a20b8bb99b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2de7cf87-b7c8-4787-b529-9a20b8bb99b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510b91f9-eb6b-4e4e-8ea1-c75570189ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (510b91f9-eb6b-4e4e-8ea1-c75570189ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54344661-c137-4bbc-9913-091c8b6ff6fa', 'volume_name': 'volume-54344661-c137-4bbc-9913-091c8b6ff6fa', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606c4fae-1eff-4553-b28a-ef9c0885f1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (606c4fae-1eff-4553-b28a-ef9c0885f1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ddcb41-1056-40b8-ad82-9c9332b5cd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:42 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Volume 54344661-c137-4bbc-9913-091c8b6ff6fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54344661-c137-4bbc-9913-091c8b6ff6fa', 'volume_size': 1} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1511915522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54344661-c137-4bbc-9913-091c8b6ff6fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='837e7274ed9c44a99d2dc6e5a529cfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:42Z,use_quota=True,user_id='c240e04b9b524f17b258e50fd239b3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Creating volume 54344661-c137-4bbc-9913-091c8b6ff6fa {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:42 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54344661-c137-4bbc-9913-091c8b6ff6fa 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:42 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54344661-c137-4bbc-9913-091c8b6ff6fa 1073741824 Sep 07 14:05:42 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:42 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54344661-c137-4bbc-9913-091c8b6ff6fa 1073741824" returned: 0 in 0.462s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54344661-c137-4bbc-9913-091c8b6ff6fa {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:42 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54344661-c137-4bbc-9913-091c8b6ff6fa Sep 07 14:05:42 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:42 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54344661-c137-4bbc-9913-091c8b6ff6fa" returned: 0 in 0.259s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.612s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ddcb41-1056-40b8-ad82-9c9332b5cd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54344661-c137-4bbc-9913-091c8b6ff6fa', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789f584d-7ce2-4937-8a32-926ac3ce1b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] Creating offline snapshot a7131bb2-c04d-441b-8d2e-5bb056783097 of volume c24a3f38-5312-4d1e-8391-2f16b0db27b4 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:42 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Volume volume-54344661-c137-4bbc-9913-091c8b6ff6fa (54344661-c137-4bbc-9913-091c8b6ff6fa): created successfully Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789f584d-7ce2-4937-8a32-926ac3ce1b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Flow 'volume_create_manager' (5a0cec4f-88a3-46f0-b19f-55aa369ecef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[77813814-5bca-44dc-8c9c-0d6ed8418a93]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8e4c94ac-8bb7-4c5c-b537-710815b15088 tempest-ProjectReaderTests-1403432646 None] Created volume successfully. Sep 07 14:05:43 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 Sep 07 14:05:43 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:43 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4" returned: 0 in 0.418s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:43 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097 1G Sep 07 14:05:43 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:43 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097 1G" returned: 0 in 0.411s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:43 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097 Sep 07 14:05:43 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:44 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097" returned: 0 in 0.311s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:44 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097 is being set with open permissions: ugo+rw Sep 07 14:05:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:44 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097 Sep 07 14:05:44 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Acquiring lock "cinder-54344661-c137-4bbc-9913-091c8b6ff6fa-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Lock "cinder-54344661-c137-4bbc-9913-091c8b6ff6fa-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:44 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097" returned: 0 in 0.287s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Acquiring lock "cinder-quobyte-54344661-c137-4bbc-9913-091c8b6ff6fa" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Lock "cinder-quobyte-54344661-c137-4bbc-9913-091c8b6ff6fa" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:44 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.info Sep 07 14:05:44 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:44 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6914273-2ea4-4768-b469-9f609fb7c105]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54344661-c137-4bbc-9913-091c8b6ff6fa {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:44 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54344661-c137-4bbc-9913-091c8b6ff6fa Sep 07 14:05:44 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:44 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.info" returned: 0 in 0.275s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:44 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.info is being set with open permissions: ugo+rw Sep 07 14:05:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:44 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.info Sep 07 14:05:44 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:44 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54344661-c137-4bbc-9913-091c8b6ff6fa" returned: 0 in 0.376s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54344661-c137-4bbc-9913-091c8b6ff6fa {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:44 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54344661-c137-4bbc-9913-091c8b6ff6fa Sep 07 14:05:44 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:44 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.info" returned: 0 in 0.250s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.085s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-06843044-3962-4132-b326-c4b3dad49c49 tempest-ProjectMemberTests-215815685 None] Create snapshot completed successfully Sep 07 14:05:45 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-54344661-c137-4bbc-9913-091c8b6ff6fa" returned: 0 in 0.261s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Lock "cinder-quobyte-54344661-c137-4bbc-9913-091c8b6ff6fa" released by "delete_volume" :: held 0.678s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Created reservations ['6d236581-7304-4cb1-b7f3-759235249e41', '10bc4a6d-c35a-4300-bdd4-fa20f103254c', 'a154e49c-0cdb-44c0-b4cf-d2c0a9a288b0', '5c2dec0d-703a-4fc5-94ae-65f59394ae1e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:45 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:05:45 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-a7131bb2-c04d-441b-8d2e-5bb056783097-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:45 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.286s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Lock "cinder-a7131bb2-c04d-441b-8d2e-5bb056783097-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-c24a3f38-5312-4d1e-8391-2f16b0db27b4" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Deleted volume successfully. Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-c24a3f38-5312-4d1e-8391-2f16b0db27b4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-a7131bb2-c04d-441b-8d2e-5bb056783097" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a9d8e362-c39b-426f-8461-a20ddc27dbeb tempest-ProjectReaderTests-1403432646 None] Lock "cinder-54344661-c137-4bbc-9913-091c8b6ff6fa-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-a7131bb2-c04d-441b-8d2e-5bb056783097" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Deleting offline snapshot a7131bb2-c04d-441b-8d2e-5bb056783097 of volume c24a3f38-5312-4d1e-8391-2f16b0db27b4 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] snapshot_file for this snap is: volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1391f79a-d6fe-49c1-948e-95d0ab5c037d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:45 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097 Sep 07 14:05:45 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:46 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097" returned: 0 in 0.383s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf778b8-d795-488c-9e47-2d764d07c1ce]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Flow 'volume_create_manager' (3ee6c550-e4d2-43e9-933c-b900b4bdfecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d741f6-5e2a-4432-b659-e826c4fa82c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34d741f6-5e2a-4432-b659-e826c4fa82c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2068989175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1679a7b9-f015-454f-b389-79c8354b9aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='837e7274ed9c44a99d2dc6e5a529cfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:46Z,use_quota=True,user_id='c240e04b9b524f17b258e50fd239b3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb96c097-e125-4809-a07e-6357e8ffce95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb96c097-e125-4809-a07e-6357e8ffce95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c635db6-e5d3-478f-a528-23ef27e434a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c635db6-e5d3-478f-a528-23ef27e434a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1679a7b9-f015-454f-b389-79c8354b9aaa', 'volume_name': 'volume-1679a7b9-f015-454f-b389-79c8354b9aaa', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c47e668-0826-46ef-9c38-64c966acac1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c47e668-0826-46ef-9c38-64c966acac1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:46 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f750eacc-d52f-460a-85a0-7581e136e1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:46 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:46 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Volume 1679a7b9-f015-454f-b389-79c8354b9aaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1679a7b9-f015-454f-b389-79c8354b9aaa', 'volume_size': 1} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2068989175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1679a7b9-f015-454f-b389-79c8354b9aaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='837e7274ed9c44a99d2dc6e5a529cfb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:46Z,use_quota=True,user_id='c240e04b9b524f17b258e50fd239b3bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Creating volume 1679a7b9-f015-454f-b389-79c8354b9aaa {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:46 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1679a7b9-f015-454f-b389-79c8354b9aaa 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:46 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1679a7b9-f015-454f-b389-79c8354b9aaa 1073741824 Sep 07 14:05:46 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:46 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4" returned: 0 in 0.384s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:46 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097 Sep 07 14:05:46 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:46 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1679a7b9-f015-454f-b389-79c8354b9aaa 1073741824" returned: 0 in 0.482s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1679a7b9-f015-454f-b389-79c8354b9aaa {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:46 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1679a7b9-f015-454f-b389-79c8354b9aaa Sep 07 14:05:46 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:46 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097" returned: 0 in 0.373s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:46 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097 Sep 07 14:05:46 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:46 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1679a7b9-f015-454f-b389-79c8354b9aaa" returned: 0 in 0.259s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f750eacc-d52f-460a-85a0-7581e136e1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1679a7b9-f015-454f-b389-79c8354b9aaa', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256b4eb5-92f2-4524-b0b0-6a7c097fe962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:47 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Volume volume-1679a7b9-f015-454f-b389-79c8354b9aaa (1679a7b9-f015-454f-b389-79c8354b9aaa): created successfully Sep 07 14:05:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (256b4eb5-92f2-4524-b0b0-6a7c097fe962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Flow 'volume_create_manager' (3ee6c550-e4d2-43e9-933c-b900b4bdfecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7e8efad8-787f-4b05-98f8-458ee21f9aab tempest-ProjectReaderTests-1403432646 None] Created volume successfully. Sep 07 14:05:47 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4.a7131bb2-c04d-441b-8d2e-5bb056783097" returned: 0 in 0.267s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-a7131bb2-c04d-441b-8d2e-5bb056783097" released by "_delete_snapshot" :: held 1.500s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-c24a3f38-5312-4d1e-8391-2f16b0db27b4" released by "delete_snapshot" :: held 1.529s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:47 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Created reservations ['15f83570-7f80-4aef-b991-5d0570158741', 'a8cc36a6-0883-4a66-8458-be93c96236c2', 'b144d069-af6f-4c9f-bdb9-e0100a54d9d0', '57b7747a-487b-4e44-b574-d76bee96843a'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Delete snapshot completed successfully. Sep 07 14:05:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-eee840b9-d010-43e9-a2ff-fbc4005ec485 tempest-ProjectMemberTests-215815685 None] Lock "cinder-a7131bb2-c04d-441b-8d2e-5bb056783097-delete_snapshot" released by "delete_snapshot" :: held 1.679s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-c24a3f38-5312-4d1e-8391-2f16b0db27b4-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Lock "cinder-c24a3f38-5312-4d1e-8391-2f16b0db27b4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-c24a3f38-5312-4d1e-8391-2f16b0db27b4" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-c24a3f38-5312-4d1e-8391-2f16b0db27b4" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:47 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[208bcfb2-35b3-4420-9b6c-97131f2634c9]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:47 devstack sudo[107508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 Sep 07 14:05:47 devstack sudo[107508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Acquiring lock "cinder-1679a7b9-f015-454f-b389-79c8354b9aaa-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:48 devstack sudo[107508]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4" returned: 0 in 0.379s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Lock "cinder-1679a7b9-f015-454f-b389-79c8354b9aaa-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:48 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4 Sep 07 14:05:48 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Acquiring lock "cinder-quobyte-1679a7b9-f015-454f-b389-79c8354b9aaa" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Lock "cinder-quobyte-1679a7b9-f015-454f-b389-79c8354b9aaa" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0ca603-5081-4d7c-9c98-d87e19b04eb8]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1679a7b9-f015-454f-b389-79c8354b9aaa {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:48 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1679a7b9-f015-454f-b389-79c8354b9aaa Sep 07 14:05:48 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:48 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a3f38-5312-4d1e-8391-2f16b0db27b4" returned: 0 in 0.265s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-c24a3f38-5312-4d1e-8391-2f16b0db27b4" released by "delete_volume" :: held 0.698s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Created reservations ['539511d4-3a13-4a67-a4b9-e51d11eacf06', 'c6edf35a-5f33-4366-871a-614405c8cf63', '2df46c54-cf9c-480a-badf-a6c28cd1901d', '57a0f638-61d7-4800-af65-93ed12c5e231'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:48 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:05:48 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:48 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1679a7b9-f015-454f-b389-79c8354b9aaa" returned: 0 in 0.390s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1679a7b9-f015-454f-b389-79c8354b9aaa {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:48 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1679a7b9-f015-454f-b389-79c8354b9aaa Sep 07 14:05:48 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:48 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.294s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:48 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Deleted volume successfully. Sep 07 14:05:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4912229a-c703-4bf5-82b0-1c668e751613 tempest-ProjectMemberTests-215815685 None] Lock "cinder-c24a3f38-5312-4d1e-8391-2f16b0db27b4-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:49 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-1679a7b9-f015-454f-b389-79c8354b9aaa" returned: 0 in 0.274s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Lock "cinder-quobyte-1679a7b9-f015-454f-b389-79c8354b9aaa" released by "delete_volume" :: held 0.708s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Created reservations ['43c28b70-19a1-4c97-9834-dbaadf27acaf', '8d074264-c9ad-470f-9d85-d439b7b39154', 'bc7ce54f-cca7-4cdc-92c4-b27b289e61dc', '17405b03-4da0-4876-9a7d-7ad7392ca6e0'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:49 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:05:49 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:49 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.305s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Deleted volume successfully. Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (159883f2-767b-4fa8-bc7e-15c2c7a12785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3d8671-cdcb-4483-abad-e77df8f478e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ff64eb36-07f4-4478-ad43-6bcd105aacde tempest-ProjectReaderTests-1403432646 None] Lock "cinder-1679a7b9-f015-454f-b389-79c8354b9aaa-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be3d8671-cdcb-4483-abad-e77df8f478e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1697730712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e993f361-75c1-4cb0-a49f-6f871d485e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:49Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cffd048f-bd50-464a-9dfb-f867718c9927) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cffd048f-bd50-464a-9dfb-f867718c9927) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0d59b0-5438-4a34-9ac6-e83289fc1f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a0d59b0-5438-4a34-9ac6-e83289fc1f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e993f361-75c1-4cb0-a49f-6f871d485e5f', 'volume_name': 'volume-e993f361-75c1-4cb0-a49f-6f871d485e5f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61993f1f-7811-4685-8312-1b66a0be0e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61993f1f-7811-4685-8312-1b66a0be0e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafe76df-a0d7-457b-836d-e63dc27408a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:49 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Volume e993f361-75c1-4cb0-a49f-6f871d485e5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e993f361-75c1-4cb0-a49f-6f871d485e5f', 'volume_size': 1} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1697730712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e993f361-75c1-4cb0-a49f-6f871d485e5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:49Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Creating volume e993f361-75c1-4cb0-a49f-6f871d485e5f {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:49 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:05:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:49 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f 1073741824 Sep 07 14:05:49 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:50 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f 1073741824" returned: 0 in 0.534s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:50 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f Sep 07 14:05:50 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:50 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f" returned: 0 in 0.330s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafe76df-a0d7-457b-836d-e63dc27408a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e993f361-75c1-4cb0-a49f-6f871d485e5f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3cb61e6-105d-4f1f-b183-b294ed51086d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:50 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Volume volume-e993f361-75c1-4cb0-a49f-6f871d485e5f (e993f361-75c1-4cb0-a49f-6f871d485e5f): created successfully Sep 07 14:05:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3cb61e6-105d-4f1f-b183-b294ed51086d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (159883f2-767b-4fa8-bc7e-15c2c7a12785) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-450d51c5-9357-4a40-b8c8-824bcf09dd55 tempest-ProjectMemberTests-215815685 None] Created volume successfully. Sep 07 14:05:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] Creating offline snapshot cdefb977-a2dc-4903-8599-63cb1a2f8e7c of volume e993f361-75c1-4cb0-a49f-6f871d485e5f {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:51 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dc93f5-953b-466a-af53-96022fa3309c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:51 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f Sep 07 14:05:51 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:52 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f" returned: 0 in 0.375s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:52 devstack sudo[107583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c 1G Sep 07 14:05:52 devstack sudo[107583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:52 devstack sudo[107583]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c 1G" returned: 0 in 0.410s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e993f361-75c1-4cb0-a49f-6f871d485e5f -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:52 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e993f361-75c1-4cb0-a49f-6f871d485e5f -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c Sep 07 14:05:52 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:52 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e993f361-75c1-4cb0-a49f-6f871d485e5f -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c" returned: 0 in 0.281s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:52 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c is being set with open permissions: ugo+rw Sep 07 14:05:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:52 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c Sep 07 14:05:52 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:53 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c" returned: 0 in 0.243s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:53 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.info Sep 07 14:05:53 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:53 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.info" returned: 0 in 0.239s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:53 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.info is being set with open permissions: ugo+rw Sep 07 14:05:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:53 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.info Sep 07 14:05:53 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:53 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.info" returned: 0 in 0.239s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.866s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2d8f89fd-ed56-4cce-bf57-345990677ce5 tempest-ProjectMemberTests-215815685 None] Create snapshot completed successfully Sep 07 14:05:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-cdefb977-a2dc-4903-8599-63cb1a2f8e7c-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Lock "cinder-cdefb977-a2dc-4903-8599-63cb1a2f8e7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-e993f361-75c1-4cb0-a49f-6f871d485e5f" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-e993f361-75c1-4cb0-a49f-6f871d485e5f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-cdefb977-a2dc-4903-8599-63cb1a2f8e7c" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-cdefb977-a2dc-4903-8599-63cb1a2f8e7c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Deleting offline snapshot cdefb977-a2dc-4903-8599-63cb1a2f8e7c of volume e993f361-75c1-4cb0-a49f-6f871d485e5f {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:05:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] snapshot_file for this snap is: volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:05:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b63d12e-843a-4deb-bbfc-5fcda6fba662]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:54 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c Sep 07 14:05:54 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:54 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c" returned: 0 in 0.366s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e993f361-75c1-4cb0-a49f-6f871d485e5f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:05:54 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[52478d72-3989-496c-801b-d5f57e8d6fb1]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:54 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f Sep 07 14:05:54 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:54 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f" returned: 0 in 0.351s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:54 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c Sep 07 14:05:54 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:54 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c" returned: 0 in 0.335s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:55 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c Sep 07 14:05:55 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:55 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f.cdefb977-a2dc-4903-8599-63cb1a2f8e7c" returned: 0 in 0.239s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-cdefb977-a2dc-4903-8599-63cb1a2f8e7c" released by "_delete_snapshot" :: held 1.380s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-e993f361-75c1-4cb0-a49f-6f871d485e5f" released by "delete_snapshot" :: held 1.403s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:55 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Created reservations ['a6780a3c-04d7-4e92-be3a-ad33cd48dbe4', '609e413a-2d52-4978-8ef9-acff5b464209', '53d9d2d1-9797-4e0f-9414-d22a76327de4', 'c0af0272-371e-47d1-9a72-5f0d091bb968'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:55 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Delete snapshot completed successfully. Sep 07 14:05:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a42dc508-e3a9-4950-9843-09f201e276ac tempest-ProjectMemberTests-215815685 None] Lock "cinder-cdefb977-a2dc-4903-8599-63cb1a2f8e7c-delete_snapshot" released by "delete_snapshot" :: held 1.536s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-e993f361-75c1-4cb0-a49f-6f871d485e5f-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Lock "cinder-e993f361-75c1-4cb0-a49f-6f871d485e5f-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-e993f361-75c1-4cb0-a49f-6f871d485e5f" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:05:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-e993f361-75c1-4cb0-a49f-6f871d485e5f" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:05:56 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c107a55-a3f1-4435-b665-b6853964a48d]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:56 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f Sep 07 14:05:56 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:56 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f" returned: 0 in 0.362s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:56 devstack sudo[107627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f Sep 07 14:05:56 devstack sudo[107627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:56 devstack sudo[107627]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-e993f361-75c1-4cb0-a49f-6f871d485e5f" returned: 0 in 0.243s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-e993f361-75c1-4cb0-a49f-6f871d485e5f" released by "delete_volume" :: held 0.655s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:56 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Created reservations ['2d8fbbdb-90ac-49bd-977b-3cb8ede8c0fe', 'e68d2497-b303-451a-849f-6f7183f3eed8', '3794bb98-e907-4b7f-a9cd-9711830969be', '9bbd697b-08b1-4151-a1cd-13c912418ad0'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:05:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:56 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:05:56 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:57 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.247s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:05:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Deleted volume successfully. Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-555896c1-33e2-455b-a938-10f7ee7f476b tempest-ProjectMemberTests-215815685 None] Lock "cinder-e993f361-75c1-4cb0-a49f-6f871d485e5f-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (db318706-4c21-49f7-926a-93a212f2587c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c849411-85a3-4421-abe2-56a93e4b69bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c849411-85a3-4421-abe2-56a93e4b69bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-836955453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc221a37-2249-44ff-a93a-ac95e0161b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:58Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6a9d9c-3602-41a3-8e70-eecd6efdf622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6a9d9c-3602-41a3-8e70-eecd6efdf622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6c2f1c-b526-40d2-ac3c-e37b6d1ca501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6c2f1c-b526-40d2-ac3c-e37b6d1ca501) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc221a37-2249-44ff-a93a-ac95e0161b07', 'volume_name': 'volume-bc221a37-2249-44ff-a93a-ac95e0161b07', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b90918a-e3c0-4b3b-bc5e-5da4ba70419b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b90918a-e3c0-4b3b-bc5e-5da4ba70419b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedc090e-cdf0-48c8-a57d-8a8df9299053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:57 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Volume bc221a37-2249-44ff-a93a-ac95e0161b07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc221a37-2249-44ff-a93a-ac95e0161b07', 'volume_size': 1} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:05:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-836955453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc221a37-2249-44ff-a93a-ac95e0161b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:05:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:05:58Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Creating volume bc221a37-2249-44ff-a93a-ac95e0161b07 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:05:57 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:05:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:57 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07 1073741824 Sep 07 14:05:57 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:58 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07 1073741824" returned: 0 in 0.407s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:58 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07 Sep 07 14:05:58 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:58 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07" returned: 0 in 0.236s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:05:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:05:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedc090e-cdf0-48c8-a57d-8a8df9299053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc221a37-2249-44ff-a93a-ac95e0161b07', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b65d308-9913-4d78-9f8d-a8e07fb91575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:05:58 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Volume volume-bc221a37-2249-44ff-a93a-ac95e0161b07 (bc221a37-2249-44ff-a93a-ac95e0161b07): created successfully Sep 07 14:05:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b65d308-9913-4d78-9f8d-a8e07fb91575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:05:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (db318706-4c21-49f7-926a-93a212f2587c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:05:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-bc10c9c7-3af8-4e9d-a8f2-f568082e4872 tempest-ProjectMemberTests-215815685 None] Created volume successfully. Sep 07 14:05:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:05:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:05:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] Creating offline snapshot c21ab399-fb5c-4042-acb0-a325a33f75ef of volume bc221a37-2249-44ff-a93a-ac95e0161b07 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:05:58 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6c7cc1-8c96-4d0c-8323-a8d346adcacd]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:05:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:58 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07 Sep 07 14:05:58 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:59 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07" returned: 0 in 0.347s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:59 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef 1G Sep 07 14:05:59 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:59 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef 1G" returned: 0 in 0.378s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc221a37-2249-44ff-a93a-ac95e0161b07 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:59 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc221a37-2249-44ff-a93a-ac95e0161b07 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef Sep 07 14:05:59 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:59 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bc221a37-2249-44ff-a93a-ac95e0161b07 -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef" returned: 0 in 0.284s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:05:59 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef is being set with open permissions: ugo+rw Sep 07 14:05:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:05:59 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef Sep 07 14:05:59 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:05:59 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Sep 07 14:05:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef" returned: 0 in 0.231s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:00 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.info Sep 07 14:06:00 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:00 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.info" returned: 0 in 0.242s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:00 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.info is being set with open permissions: ugo+rw Sep 07 14:06:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:00 devstack sudo[107670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.info Sep 07 14:06:00 devstack sudo[107670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:00 devstack sudo[107670]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.info" returned: 0 in 0.253s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.813s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:00 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e9be1cb9-4049-4ec0-982e-96c15d9a2f75 tempest-ProjectMemberTests-215815685 None] Create snapshot completed successfully Sep 07 14:06:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-c21ab399-fb5c-4042-acb0-a325a33f75ef-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Lock "cinder-c21ab399-fb5c-4042-acb0-a325a33f75ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-bc221a37-2249-44ff-a93a-ac95e0161b07" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-bc221a37-2249-44ff-a93a-ac95e0161b07" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-c21ab399-fb5c-4042-acb0-a325a33f75ef" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-c21ab399-fb5c-4042-acb0-a325a33f75ef" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Deleting offline snapshot c21ab399-fb5c-4042-acb0-a325a33f75ef of volume bc221a37-2249-44ff-a93a-ac95e0161b07 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:06:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] snapshot_file for this snap is: volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:06:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[062a2363-a891-42da-8717-659a48db071c]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:01 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef Sep 07 14:06:01 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:01 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef" returned: 0 in 0.353s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bc221a37-2249-44ff-a93a-ac95e0161b07(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:06:01 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc85a157-0354-4850-857f-40106ab66a93]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:01 devstack sudo[107678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07 Sep 07 14:06:01 devstack sudo[107678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:01 devstack sudo[107678]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07" returned: 0 in 0.348s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:01 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef Sep 07 14:06:01 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:01 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef" returned: 0 in 0.325s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:02 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef Sep 07 14:06:02 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:02 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07.c21ab399-fb5c-4042-acb0-a325a33f75ef" returned: 0 in 0.243s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-c21ab399-fb5c-4042-acb0-a325a33f75ef" released by "_delete_snapshot" :: held 1.353s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-bc221a37-2249-44ff-a93a-ac95e0161b07" released by "delete_snapshot" :: held 1.374s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:02 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Created reservations ['35c6720d-64fc-4551-ba31-7e1501493816', '5ee3aba2-f40a-480e-be20-1645fbfd7076', 'd4647b6b-540a-488f-b4c3-cc6e7788cb12', '8b243430-b187-4f31-9322-8e7fe7c5b72c'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:06:02 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Delete snapshot completed successfully. Sep 07 14:06:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-179f535f-b8e9-47ae-ad4e-63e45422b4d1 tempest-ProjectMemberTests-215815685 None] Lock "cinder-c21ab399-fb5c-4042-acb0-a325a33f75ef-delete_snapshot" released by "delete_snapshot" :: held 1.506s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-bc221a37-2249-44ff-a93a-ac95e0161b07-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Lock "cinder-bc221a37-2249-44ff-a93a-ac95e0161b07-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-bc221a37-2249-44ff-a93a-ac95e0161b07" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-bc221a37-2249-44ff-a93a-ac95e0161b07" acquired by "delete_volume" :: waited 0.013s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9942fb-7ae8-432f-bb39-8674cd4e4285]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:03 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07 Sep 07 14:06:03 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:03 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07" returned: 0 in 0.352s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:03 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07 Sep 07 14:06:03 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:03 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-bc221a37-2249-44ff-a93a-ac95e0161b07" returned: 0 in 0.233s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-bc221a37-2249-44ff-a93a-ac95e0161b07" released by "delete_volume" :: held 0.636s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Created reservations ['2c07213b-3863-4eb5-9789-0200eca8faf2', '37021be9-310b-47b2-b522-89b072dfca5c', '227a9966-a3fe-4b6e-94b9-24914319f7e2', 'ecd6992d-056b-4793-b3f9-96c7dbddf44d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:03 devstack sudo[107700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:06:03 devstack sudo[107700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:04 devstack sudo[107700]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.233s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:06:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Deleted volume successfully. Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1939481b-8ba9-42f4-8cb2-d7f2e092bf10 tempest-ProjectMemberTests-215815685 None] Lock "cinder-bc221a37-2249-44ff-a93a-ac95e0161b07-delete_volume" released by "delete_volume" :: held 1.060s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (2dcc1cec-2af0-4d7c-b58c-de49a40c9dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95098a9e-a812-43fb-b6f6-2412e93ad5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95098a9e-a812-43fb-b6f6-2412e93ad5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907758307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8400125-5d6b-484a-ae27-0b0ca4f9b00b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:06:05Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1843af3e-cf43-495f-a27a-627ae4abc9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1843af3e-cf43-495f-a27a-627ae4abc9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8671f27-2d98-4d9a-84a5-e4b7f76c643d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8671f27-2d98-4d9a-84a5-e4b7f76c643d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8400125-5d6b-484a-ae27-0b0ca4f9b00b', 'volume_name': 'volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de0687d-d306-42d6-acf7-8355b829bca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4de0687d-d306-42d6-acf7-8355b829bca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc81ed0c-e026-444f-ae25-dbbbb3b577e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:04 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Volume f8400125-5d6b-484a-ae27-0b0ca4f9b00b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b', 'volume_size': 1} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:06:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907758307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8400125-5d6b-484a-ae27-0b0ca4f9b00b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:06:05Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Creating volume f8400125-5d6b-484a-ae27-0b0ca4f9b00b {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:06:04 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:06:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:04 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b 1073741824 Sep 07 14:06:04 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:05 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b 1073741824" returned: 0 in 0.380s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:05 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b Sep 07 14:06:05 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:05 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b" returned: 0 in 0.235s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] <== create_volume: return (656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:06:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.658s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc81ed0c-e026-444f-ae25-dbbbb3b577e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1ff5ee-b340-4da6-9c80-823fde3f91cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:05 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Volume volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b (f8400125-5d6b-484a-ae27-0b0ca4f9b00b): created successfully Sep 07 14:06:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e1ff5ee-b340-4da6-9c80-823fde3f91cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (2dcc1cec-2af0-4d7c-b58c-de49a40c9dfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:06:05 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dc5e8ad8-fd75-468f-95f0-e49a58ba502d tempest-ProjectMemberTests-215815685 None] Created volume successfully. Sep 07 14:06:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] Creating offline snapshot 816010a7-63ec-48dd-b1ce-c81bc8ab514a of volume f8400125-5d6b-484a-ae27-0b0ca4f9b00b {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:06:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f665460-59e8-491b-b31d-9bc4ea2dcc96]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:05 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b Sep 07 14:06:05 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:06 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b" returned: 0 in 0.343s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:06 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a 1G Sep 07 14:06:06 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:06 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a 1G" returned: 0 in 0.384s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:06 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a Sep 07 14:06:06 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:06 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a" returned: 0 in 0.291s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:06 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a is being set with open permissions: ugo+rw Sep 07 14:06:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:06 devstack sudo[107730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a Sep 07 14:06:06 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:07 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a" returned: 0 in 0.236s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:07 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.info Sep 07 14:06:07 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:07 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.info" returned: 0 in 0.241s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:07 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.info is being set with open permissions: ugo+rw Sep 07 14:06:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:07 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.info Sep 07 14:06:07 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:07 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.info" returned: 0 in 0.228s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.796s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2e919c56-ba50-4c59-b0f1-5a5368f703f0 tempest-ProjectMemberTests-215815685 None] Create snapshot completed successfully Sep 07 14:06:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-816010a7-63ec-48dd-b1ce-c81bc8ab514a-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Lock "cinder-816010a7-63ec-48dd-b1ce-c81bc8ab514a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-f8400125-5d6b-484a-ae27-0b0ca4f9b00b" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-f8400125-5d6b-484a-ae27-0b0ca4f9b00b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-816010a7-63ec-48dd-b1ce-c81bc8ab514a" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-816010a7-63ec-48dd-b1ce-c81bc8ab514a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Deleting offline snapshot 816010a7-63ec-48dd-b1ce-c81bc8ab514a of volume f8400125-5d6b-484a-ae27-0b0ca4f9b00b {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:06:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] snapshot_file for this snap is: volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:06:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44d9356-b35c-4749-b631-0f76d6f46d4a]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:08 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a Sep 07 14:06:08 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:08 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a" returned: 0 in 0.346s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:06:08 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d2288b-3e4d-4bee-a38d-b39029c66c29]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:08 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b Sep 07 14:06:08 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:08 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b" returned: 0 in 0.333s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:08 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a Sep 07 14:06:08 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:08 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a" returned: 0 in 0.338s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:09 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a Sep 07 14:06:09 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:09 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b.816010a7-63ec-48dd-b1ce-c81bc8ab514a" returned: 0 in 0.234s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-816010a7-63ec-48dd-b1ce-c81bc8ab514a" released by "_delete_snapshot" :: held 1.332s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-f8400125-5d6b-484a-ae27-0b0ca4f9b00b" released by "delete_snapshot" :: held 1.353s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:09 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Created reservations ['b5ea1a91-897d-42bb-b773-8f275e29e218', 'e66df2f7-303a-4ef2-ae50-4fa170985c22', 'dd79f1f8-99dc-4608-90b1-139facdb8b74', 'ff382904-581c-4e35-ab79-94d26bcf2c92'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:06:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Delete snapshot completed successfully. Sep 07 14:06:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d6960d4-198a-4071-8cfe-e4b63517b128 tempest-ProjectMemberTests-215815685 None] Lock "cinder-816010a7-63ec-48dd-b1ce-c81bc8ab514a-delete_snapshot" released by "delete_snapshot" :: held 1.476s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-f8400125-5d6b-484a-ae27-0b0ca4f9b00b-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Lock "cinder-f8400125-5d6b-484a-ae27-0b0ca4f9b00b-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-f8400125-5d6b-484a-ae27-0b0ca4f9b00b" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-f8400125-5d6b-484a-ae27-0b0ca4f9b00b" acquired by "delete_volume" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5120a2-a827-40e6-85ff-cb07fd9540f2]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:10 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b Sep 07 14:06:10 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:10 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b" returned: 0 in 0.336s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:10 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b Sep 07 14:06:10 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:10 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-f8400125-5d6b-484a-ae27-0b0ca4f9b00b" returned: 0 in 0.229s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-f8400125-5d6b-484a-ae27-0b0ca4f9b00b" released by "delete_volume" :: held 0.616s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Created reservations ['7c85c5b0-77a8-4f10-b8a3-6fa22818c0ce', 'd22f2461-3288-4eb7-b283-4d9c5b87f88c', 'b200880e-9c26-436e-b899-11f475f9d7e0', 'fd56f7cf-7d78-40a6-9fdf-77d7951861fa'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:10 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:06:10 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:11 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.235s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:06:11 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Deleted volume successfully. Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04563f3d-3a29-4035-a41e-0d7afed6c3e4 tempest-ProjectMemberTests-215815685 None] Lock "cinder-f8400125-5d6b-484a-ae27-0b0ca4f9b00b-delete_volume" released by "delete_volume" :: held 1.035s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (63ecd8a5-8177-40a4-ab48-b2e82e94b6e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8ca8ce-be05-4b08-97e8-13c990dd771f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe8ca8ce-be05-4b08-97e8-13c990dd771f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-130444102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24a5c49-33e7-442c-9d24-3cce0db70aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:06:12Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2a9cb4-9b50-4f6d-b7aa-e5baf1117a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf2a9cb4-9b50-4f6d-b7aa-e5baf1117a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c7f7e5-3cdc-41c4-900e-f77f430a4ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c7f7e5-3cdc-41c4-900e-f77f430a4ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c24a5c49-33e7-442c-9d24-3cce0db70aee', 'volume_name': 'volume-c24a5c49-33e7-442c-9d24-3cce0db70aee', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (375dacab-6da9-42c0-ba4c-e112d2f6b5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (375dacab-6da9-42c0-ba4c-e112d2f6b5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845e133f-2d55-4a21-81a4-b36d1badfdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:11 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Volume c24a5c49-33e7-442c-9d24-3cce0db70aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c24a5c49-33e7-442c-9d24-3cce0db70aee', 'volume_size': 1} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-07T12:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-130444102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c24a5c49-33e7-442c-9d24-3cce0db70aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42bf35f2894bfeb75b61d52a2de73c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-07T12:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-07T12:06:12Z,use_quota=True,user_id='4833837b285149539594976f8757473e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c9fff0c9-6224-45a5-8a00-6801fdfcc36f),volume_type_id=c9fff0c9-6224-45a5-8a00-6801fdfcc36f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Creating volume c24a5c49-33e7-442c-9d24-3cce0db70aee {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Selected osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 07 14:06:11 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] casted to osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35 Sep 07 14:06:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:11 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee 1073741824 Sep 07 14:06:11 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:12 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee 1073741824" returned: 0 in 0.407s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:12 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee Sep 07 14:06:12 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:12 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee" returned: 0 in 0.243s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 07 14:06:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (845e133f-2d55-4a21-81a4-b36d1badfdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c24a5c49-33e7-442c-9d24-3cce0db70aee', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bef219-0a8c-481f-a450-4891c6134fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 07 14:06:12 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Volume volume-c24a5c49-33e7-442c-9d24-3cce0db70aee (c24a5c49-33e7-442c-9d24-3cce0db70aee): created successfully Sep 07 14:06:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bef219-0a8c-481f-a450-4891c6134fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 07 14:06:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Flow 'volume_create_manager' (63ecd8a5-8177-40a4-ab48-b2e82e94b6e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 07 14:06:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-23614de1-32f2-40c3-9513-2f5318226df9 tempest-ProjectMemberTests-215815685 None] Created volume successfully. Sep 07 14:06:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] Creating offline snapshot dc927c00-cbdc-48c2-8b99-f4c2fdaec787 of volume c24a5c49-33e7-442c-9d24-3cce0db70aee {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 07 14:06:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c15cfda-f1c4-46e7-986d-e89e9d47fe76]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:12 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee Sep 07 14:06:12 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:13 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee" returned: 0 in 0.351s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:13 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787 1G Sep 07 14:06:13 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:13 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787 1G" returned: 0 in 0.394s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24a5c49-33e7-442c-9d24-3cce0db70aee -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:13 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24a5c49-33e7-442c-9d24-3cce0db70aee -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787 Sep 07 14:06:13 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:13 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c24a5c49-33e7-442c-9d24-3cce0db70aee -F qcow2 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787" returned: 0 in 0.298s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:13 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787 is being set with open permissions: ugo+rw Sep 07 14:06:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:13 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787 Sep 07 14:06:13 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:14 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787" returned: 0 in 0.232s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:14 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.info Sep 07 14:06:14 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:14 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.info" returned: 0 in 0.263s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:14 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.info is being set with open permissions: ugo+rw Sep 07 14:06:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:14 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.info Sep 07 14:06:14 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:14 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.info" returned: 0 in 0.237s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.860s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c500f84c-c1c3-4052-8a21-5bd5bb69d525 tempest-ProjectMemberTests-215815685 None] Create snapshot completed successfully Sep 07 14:06:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-dc927c00-cbdc-48c2-8b99-f4c2fdaec787-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Lock "cinder-dc927c00-cbdc-48c2-8b99-f4c2fdaec787-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-c24a5c49-33e7-442c-9d24-3cce0db70aee" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-c24a5c49-33e7-442c-9d24-3cce0db70aee" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-dc927c00-cbdc-48c2-8b99-f4c2fdaec787" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-dc927c00-cbdc-48c2-8b99-f4c2fdaec787" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Deleting offline snapshot dc927c00-cbdc-48c2-8b99-f4c2fdaec787 of volume c24a5c49-33e7-442c-9d24-3cce0db70aee {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 07 14:06:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] snapshot_file for this snap is: volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 07 14:06:15 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[766f27a4-5385-4ddd-bb01-8db13bf834e2]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:15 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787 Sep 07 14:06:15 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:15 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787" returned: 0 in 0.343s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c24a5c49-33e7-442c-9d24-3cce0db70aee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 07 14:06:15 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe003d34-f92e-40aa-bd21-7ce70068e0a0]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:15 devstack sudo[107806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee Sep 07 14:06:15 devstack sudo[107806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:15 devstack sudo[107806]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee" returned: 0 in 0.336s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:15 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787 Sep 07 14:06:15 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:16 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787" returned: 0 in 0.329s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:16 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787 Sep 07 14:06:16 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:16 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee.dc927c00-cbdc-48c2-8b99-f4c2fdaec787" returned: 0 in 0.234s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-dc927c00-cbdc-48c2-8b99-f4c2fdaec787" released by "_delete_snapshot" :: held 1.329s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-c24a5c49-33e7-442c-9d24-3cce0db70aee" released by "delete_snapshot" :: held 1.349s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:16 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Created reservations ['405451c1-4232-4c31-9a98-f4e2fc86f633', 'c5700719-105b-47dd-ab03-1ada22dc85e0', '741a6c45-3b50-430b-a86c-6997f20c68d3', 'b4cb9482-463e-470f-84a8-94cdfd244f4f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:06:16 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Delete snapshot completed successfully. Sep 07 14:06:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cdd40efb-8c0d-49c8-b632-8f11bc91ad0e tempest-ProjectMemberTests-215815685 None] Lock "cinder-dc927c00-cbdc-48c2-8b99-f4c2fdaec787-delete_snapshot" released by "delete_snapshot" :: held 1.475s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-c24a5c49-33e7-442c-9d24-3cce0db70aee-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Lock "cinder-c24a5c49-33e7-442c-9d24-3cce0db70aee-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Acquiring lock "cinder-quobyte-c24a5c49-33e7-442c-9d24-3cce0db70aee" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-c24a5c49-33e7-442c-9d24-3cce0db70aee" acquired by "delete_volume" :: waited 0.013s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[77719cc9-f953-4530-b5be-cf14ab15f6c2]: (4, 'qcow2') {{(pid=88374) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:17 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee Sep 07 14:06:17 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:17 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee" returned: 0 in 0.349s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:17 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee Sep 07 14:06:17 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:17 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496/volume-c24a5c49-33e7-442c-9d24-3cce0db70aee" returned: 0 in 0.248s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Lock "cinder-quobyte-c24a5c49-33e7-442c-9d24-3cce0db70aee" released by "delete_volume" :: held 0.651s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Created reservations ['ca227065-7edc-4fad-b6ab-f73a404a7a13', '9b4cd755-213e-456d-a5b2-30e1081ab728', '17e6a6a3-775f-43bc-b263-0748c46082bd', 'd883822a-3ae8-4e36-a5c4-646291639251'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:17 devstack sudo[107827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:06:17 devstack sudo[107827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:18 devstack sudo[107827]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.259s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:18 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:06:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Deleted volume successfully. Sep 07 14:06:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8f3edb8f-612f-4f94-8565-bc417a828feb tempest-ProjectMemberTests-215815685 None] Lock "cinder-c24a5c49-33e7-442c-9d24-3cce0db70aee-delete_volume" released by "delete_volume" :: held 1.098s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 07 14:06:27 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=94,cinder:INSERT=32,cinder:UPDATE=117,cinder:DELETE=12 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:06:28 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:INSERT=32,cinder:UPDATE=122,cinder:SELECT=81,cinder:DELETE=8 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 07 14:06:29 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:06:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 07 14:06:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 07 14:06:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 07 14:06:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-7a9b7ea2-ce8f-46e4-9f30-80a27e485a35'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 07 14:06:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 07 14:06:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 07 14:06:29 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496 Sep 07 14:06:29 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 07 14:06:30 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Sep 07 14:06:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/784b6214646cb4fa916cfc860c21d496" returned: 0 in 0.270s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 07 14:06:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 07 14:06:30 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 07 14:06:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread count: 29 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 07 14:06:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-39a9cb2e-3063-4382-9518-907de69d8223 None None] thread info: [<_MainThread(MainThread, started 139895851286656)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}